-- Logs begin at Fri 2022-07-29 12:07:38 UTC, end at Fri 2022-07-29 13:38:07 UTC. -- Jul 29 12:41:33.051864 dv-cinder-819149-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 12:41:33.059934 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 12:41:33 2022] *** Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: nodename: dv-cinder-819149-16-iscsi Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: machine: x86_64 Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: clock source: unix Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: pcre jit disabled Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: detected number of CPU cores: 4 Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: current working directory: / Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: detected binary path: /usr/bin/uwsgi-core Jul 29 12:41:33.062527 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: your processes number limit is 47680 Jul 29 12:41:33.063288 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: your memory page size is 4096 bytes Jul 29 12:41:33.063288 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: detected max file descriptor number: 2048 Jul 29 12:41:33.063288 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: lock engine: pthread robust mutexes Jul 29 12:41:33.063288 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: thunder lock: enabled Jul 29 12:41:33.063288 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 12:41:33.063288 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 12:41:33.102622 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: Python main interpreter initialized at 0x55da0cf019c0 Jul 29 12:41:33.102622 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: python threads support enabled Jul 29 12:41:33.102622 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: your server socket listen backlog is limited to 100 connections Jul 29 12:41:33.102622 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: your mercy for graceful operations on workers is 90 seconds Jul 29 12:41:33.102971 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 12:41:33.103053 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: *** Operational MODE: preforking *** Jul 29 12:41:33.103276 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: *** uWSGI is running in multiple interpreter mode *** Jul 29 12:41:33.103276 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: spawned uWSGI master process (pid: 114825) Jul 29 12:41:33.103466 dv-cinder-819149-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 12:41:33.104063 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: spawned uWSGI worker 1 (pid: 114826, cores: 1) Jul 29 12:41:33.105864 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: spawned uWSGI worker 2 (pid: 114827, cores: 1) Jul 29 12:41:33.105864 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 12:41:33.773029 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 12:41:33.778475 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 12:41:34.884774 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:41:34.884774 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: from cryptography.utils import int_from_bytes Jul 29 12:41:34.885491 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:41:34.885491 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: from cryptography.utils import int_from_bytes Jul 29 12:41:34.894198 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:41:34.894198 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: from cryptography.utils import int_from_bytes Jul 29 12:41:34.894614 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:41:34.894614 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: from cryptography.utils import int_from_bytes Jul 29 12:41:37.367670 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 12:41:37.368323 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 12:41:37.368410 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 12:41:37.368759 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 12:41:37.369010 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 12:41:37.369389 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.369710 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.370100 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.370229 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 12:41:37.370585 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.370667 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 12:41:37.370776 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.370969 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.371071 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 12:41:37.371281 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.371375 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 12:41:37.371616 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.371726 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 12:41:37.371939 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372026 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372195 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372325 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372503 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372644 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372818 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-16-iscsi {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.372961 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.373128 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.373291 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.373427 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.373601 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.373729 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.373950 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.374277 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.374605 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.374863 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.375179 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.375502 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-16-iscsi {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.376376 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.376515 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.376692 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.376824 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.377001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.377139 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.377313 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.377447 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.377614 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.377807 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379076 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379076 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379339 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379339 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379595 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379719 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379854 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.379968 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380103 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380236 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380367 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380497 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380620 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380743 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.380876 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381009 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381129 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381252 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381386 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381520 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381668 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381794 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-16-iscsi {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.381951 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382087 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382221 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382348 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382459 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-16-iscsi {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382581 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382714 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382846 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.382978 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383098 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383236 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383371 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383508 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383622 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383740 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.383946 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384079 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384202 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384329 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384461 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384606 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384739 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.384898 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385028 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385222 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385351 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385513 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385649 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385813 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.385966 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.386134 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.386264 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.386450 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.386573 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.386746 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.386880 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387044 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387173 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387311 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387443 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387569 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387693 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387870 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.387999 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.388168 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.388297 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.388473 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.388613 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.388747 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.388879 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389003 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389127 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389250 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389381 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389544 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389691 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389848 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.389975 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.390151 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.390278 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.390503 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.390638 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.390766 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.390890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.391037 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.391166 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.391921 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392056 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392181 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392347 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392484 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392619 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392744 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.392878 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.393035 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.393164 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.393347 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.393485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.393646 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.393857 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394082 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394219 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394345 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394603 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394715 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394857 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.394991 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.395187 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.395326 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.395498 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.395626 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.395799 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.395929 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.396116 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.396258 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.396428 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.396556 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.396728 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.396866 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397028 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397158 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397326 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397468 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397629 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397755 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.397959 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398092 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398255 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398391 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398516 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398647 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398786 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.398911 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399065 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399198 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399373 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399502 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399670 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399799 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.399970 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400110 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400264 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400424 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400551 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400684 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400821 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.400947 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.401120 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.401267 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.401401 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.401526 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.401702 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.401862 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402021 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402177 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402306 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402438 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402605 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402735 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.402902 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403041 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403196 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403333 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403506 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403635 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403815 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.403953 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.404119 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.404265 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.404418 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.404554 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.404722 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.404870 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405007 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405133 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405296 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405426 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405595 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405738 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.405917 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406065 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406232 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406361 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406529 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406705 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406831 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.406963 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.407701 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.407833 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408007 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408136 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408306 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408434 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408617 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408745 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.408911 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.409039 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.409212 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.409349 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.409520 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.409664 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.409803 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410012 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410142 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410265 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410417 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410564 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410705 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.410831 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411002 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411140 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411301 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411431 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411596 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411727 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.411892 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412023 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412184 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412331 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412484 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412612 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412774 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.412901 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.413070 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.413209 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.413370 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.413498 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.413669 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.413811 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.414002 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.414147 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.414351 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.414478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.414603 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.414726 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.414895 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:41:37.415026 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.415230 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.415359 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.415561 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.415682 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.415895 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416032 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416209 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416338 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416517 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416653 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416827 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.416958 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.417146 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.417275 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.417452 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.417580 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.417759 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.417953 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418081 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418208 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418390 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418610 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418737 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418861 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.418984 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.419109 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.419302 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.419441 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.419612 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.419740 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.419928 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420057 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420234 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420380 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420548 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420686 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420867 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.420998 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.421181 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.421322 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.421488 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.421621 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.421833 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.421973 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.422166 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.422303 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.422470 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.422597 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.422830 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.422969 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.423147 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.423284 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.423456 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.423594 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.423758 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.423885 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424062 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424186 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424382 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424692 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424794 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.424999 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.425109 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.425316 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.425413 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.425624 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.425739 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.425953 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426064 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426258 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426345 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426563 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426665 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426867 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.426955 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.427175 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.427261 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.427488 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.427583 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.427797 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.427881 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.428104 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.428192 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.428438 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.428547 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.428741 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.428828 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429045 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429131 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429346 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429441 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429643 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429729 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.429977 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430080 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430279 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430374 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430583 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430669 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430882 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.430968 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.431184 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.431278 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.431494 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.431579 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.431791 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.431876 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.432112 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.432197 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.432409 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.432494 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.432714 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.432800 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433021 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433107 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433325 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433411 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433624 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433710 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.433948 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434037 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434256 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434350 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434555 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434650 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434862 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.434948 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.435169 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.435252 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.435469 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.435564 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.435784 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.435878 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436084 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436169 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436382 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436475 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436690 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436775 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.436990 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.437074 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.437294 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.437390 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.437597 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.437682 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.437930 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438024 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438267 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438366 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438580 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438676 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438888 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.438983 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.439208 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.439295 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.439517 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.439603 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.439818 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.439903 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.440135 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.440221 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.440452 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.440537 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.440756 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.440839 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441050 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441137 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441353 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441448 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441650 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441742 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.441970 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442058 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442270 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442355 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442573 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442668 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442870 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.442963 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.443170 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.443255 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.443466 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.443559 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.443764 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.443850 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444065 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444150 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444368 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444475 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444669 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444755 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.444970 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445054 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445268 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445363 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445567 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445652 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445901 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.445986 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.446207 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.446295 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.446510 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.446595 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.446852 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.446938 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.447158 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.447244 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.447472 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.447564 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.447778 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.447870 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.448123 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.448217 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.448396 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.448482 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.448700 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.448785 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449003 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449089 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449309 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449394 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449617 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449710 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.449946 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450257 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450352 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450562 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450657 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450874 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.450959 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.451176 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.451261 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.451491 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.451591 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.451792 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.451884 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.452098 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.452197 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.452414 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.452514 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.452720 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.452804 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.453035 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.453128 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.453347 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.453440 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.453653 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.453738 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.454523 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.454615 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.454832 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.454927 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.455136 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.455221 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.455441 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.455534 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.455746 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.455834 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456051 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456130 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456354 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456438 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456659 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456751 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.456961 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.457053 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.457271 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.457354 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.457575 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.457666 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.457902 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458007 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458202 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458300 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458512 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458597 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458826 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.458910 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.459133 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.459231 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.459441 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.459526 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.459746 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.459843 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460064 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460159 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460371 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460463 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460677 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460769 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.460983 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.461075 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.461284 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.461370 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.461584 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.461670 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.461915 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462004 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462222 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462305 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462527 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462623 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462834 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.462920 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.463132 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.463217 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.463442 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.463536 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.463744 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.463830 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464042 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464128 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464344 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464474 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464649 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464736 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.464950 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.465041 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.465253 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.465351 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.465563 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.465649 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.465900 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466000 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466202 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466297 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466500 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466588 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466814 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.466900 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.467115 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.467470 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.467676 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.467760 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.467973 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468066 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468272 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468368 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468578 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468672 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468883 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.468976 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.469185 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.469278 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.469520 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.469606 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.469896 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.469983 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.470206 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.470297 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.470510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.470594 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.470814 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.470908 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.471115 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.471209 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.471426 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.471511 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.471733 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.471817 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472036 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472131 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472339 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472425 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472642 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472736 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.472945 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473031 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473247 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473334 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473554 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473654 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473877 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.473976 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.474187 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.474282 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.474516 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.474620 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.474787 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.474874 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.475090 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.475176 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.475396 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.475490 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.475700 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.475953 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.476046 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.476285 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.476365 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.476598 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.476859 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.476955 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.477200 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.477287 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.477514 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.477600 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.477854 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.477941 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.478181 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.478266 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.478501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.478594 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.478800 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.478895 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.479107 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.479193 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.479407 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.479505 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.479705 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.479828 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480009 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480096 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480308 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480395 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480607 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480694 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.480904 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481000 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481208 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481294 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481506 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481600 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481805 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.481906 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.482126 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.482224 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.482425 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.482519 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.482727 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.482811 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483022 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483114 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483325 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483418 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483619 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483704 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.483936 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484029 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484235 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484320 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484531 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484691 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484828 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.484929 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.485661 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.485799 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.485998 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.486085 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.486303 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.486404 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.486608 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.486697 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.486939 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487036 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487241 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487335 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487559 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487643 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487858 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.487944 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.488172 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.488270 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.488470 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.488556 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.488766 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.488859 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489063 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489149 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489365 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489451 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489667 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489760 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.489987 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490077 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490292 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490390 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490595 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490690 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490894 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.490988 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.491195 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.491279 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.491491 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.491586 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.491791 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.491878 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492086 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492171 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492389 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492483 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492688 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492772 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.492983 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493076 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493281 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493375 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493583 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493669 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493903 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.493991 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.494201 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.494288 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.494504 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.494591 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.494801 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.494887 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.495102 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.495187 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.495396 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.495480 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.495692 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.495784 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496010 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496099 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496312 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496398 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496614 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496698 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496909 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.496994 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.497215 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.497299 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.497514 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.497599 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.497814 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.497912 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.498134 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.498221 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.498436 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.498536 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.498735 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.498822 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499033 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499116 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499337 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499431 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499638 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499723 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.499942 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.500035 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.500239 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.500332 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.500541 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.500628 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.500917 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501005 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501219 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501312 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501518 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501612 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501853 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.501944 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.502143 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.502231 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.502444 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.502533 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.502740 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.502826 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503039 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503126 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503336 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503422 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503650 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503735 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.503958 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504045 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504256 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504342 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504573 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504707 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504859 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.504950 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.505159 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.505244 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.505464 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.505564 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.505769 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.505874 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.506124 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.506218 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.506433 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.506527 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.506746 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.506844 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507052 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507139 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507356 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507454 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507664 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507750 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.507961 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508047 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508271 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508370 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508576 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508663 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508876 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.508968 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.509173 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.509308 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.509473 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.509560 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.509785 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.509938 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.510110 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.510197 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.510414 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.510498 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.510726 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.510812 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511119 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511342 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511429 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511637 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511730 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.511940 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512027 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512244 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512331 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512545 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512639 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512848 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.512941 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.513151 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.513237 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.513457 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.513550 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.513760 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.513863 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514093 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514178 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514397 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514700 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514786 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.514999 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.515088 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.515301 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.515397 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.515604 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.515699 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.515902 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.516002 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.516208 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.516828 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517042 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517136 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517340 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517426 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517644 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517731 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.517962 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518057 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518265 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518351 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518563 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518659 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518864 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.518975 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.519173 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.519265 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.519477 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.519565 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.519854 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.519939 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.520157 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.520251 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.520459 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.520545 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.520768 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.520855 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.521075 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.521167 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.521369 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.521453 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.521682 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.521766 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522022 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522122 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522325 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522410 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522672 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522756 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.522970 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523128 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523267 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523353 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523569 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523654 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523885 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.523972 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.524182 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.524275 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.524487 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.524573 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.524783 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.524870 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.525091 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.525176 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.525387 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.525479 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.525688 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.525773 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.526034 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.526137 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.526339 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.526428 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.526659 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.526746 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527071 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527156 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527378 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527471 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527680 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527764 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.527992 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.528076 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.528306 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.528400 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.528621 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.528707 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.528919 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529005 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529229 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529322 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529532 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529636 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529863 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.529953 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.530181 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.530268 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.530486 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.530589 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.530798 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.530892 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.531096 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.531182 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.531410 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.531506 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.531725 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.531817 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.532083 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.532170 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.532408 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.532504 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.532731 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.532825 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.533052 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.533145 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.533373 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.533472 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.533707 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.533799 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534059 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534149 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534359 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534456 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534664 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534779 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.534968 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.535100 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.535266 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.535396 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.535564 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.535700 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.535878 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536009 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536176 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536313 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536480 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536617 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536783 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.536938 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.537089 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.537242 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.537388 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.537551 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.537685 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.537881 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538028 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538192 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538326 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538498 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538639 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538802 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.538947 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.539123 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.539264 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.539424 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.539579 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.539744 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.539877 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.540059 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.540191 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.540381 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.540496 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.540704 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.540798 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541009 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541096 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541329 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541424 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541639 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541727 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.541967 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542055 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542273 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542377 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542577 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542664 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542913 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.542998 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.543217 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.543304 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.543535 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.543627 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.543851 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.543944 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.544162 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.544250 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.544471 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.544567 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.544787 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.544872 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.545084 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.545172 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.545381 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.545475 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.545683 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.545769 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546005 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546094 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546303 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546391 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546600 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546694 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546902 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.546990 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.547197 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.547288 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.547490 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.548085 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.548318 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.548405 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.548624 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.548717 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.548920 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549013 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549220 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549306 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549523 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549613 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549833 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.549934 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.550135 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.550223 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.550431 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.550519 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.550755 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.550842 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551053 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551139 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551354 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551448 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551656 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551744 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.551974 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.552059 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.552289 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.552384 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.552588 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.552682 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.552902 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553000 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553213 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553300 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553521 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553609 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553872 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.553964 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.554154 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.554258 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.554468 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.554561 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.554777 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.554863 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.555088 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.555182 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.555390 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.555485 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.555699 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.555787 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556007 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556102 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556315 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556409 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556623 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556827 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.556923 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.557154 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.557242 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.557468 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.557563 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.557779 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.558074 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.558162 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.558405 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.558491 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.558711 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.558804 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559020 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559107 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559328 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559415 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559634 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559729 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.559940 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560027 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560248 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560341 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560561 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560649 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560876 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.560971 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.561189 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.561276 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.561498 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.561592 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.561804 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.561924 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.562137 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.562224 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.562446 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.562611 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.562782 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.562868 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.563089 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.563174 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.563446 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.563580 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.563755 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.563850 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564069 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564164 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564380 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564475 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564691 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.564995 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.565090 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.565299 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.565385 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.565606 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.565692 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.565939 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566041 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566253 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566346 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566566 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566698 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566879 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.566977 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.567193 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.567287 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.567504 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.567635 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.567815 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.567913 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.568119 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.568205 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.568426 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.568514 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.568739 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.568833 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.569064 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.569247 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.569378 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.569555 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.569691 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.569909 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.570034 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.570230 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.570544 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.570642 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.570850 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.570937 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.571159 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.571246 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.571477 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.571572 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.571775 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.571863 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572074 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572168 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572378 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572473 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572681 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572775 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.572978 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.573072 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.573292 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.573387 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.573594 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.573680 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.573921 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.574012 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.574227 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.574315 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.574534 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.574620 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.574843 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.575055 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.575155 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.575389 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.575476 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.575697 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.575783 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.576015 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.576261 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.576348 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.576602 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.576690 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.576912 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577003 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577228 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577316 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577527 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577620 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577845 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.577947 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.578152 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.578247 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.578458 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.578597 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.578755 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.579355 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.579593 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.579692 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.579891 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580015 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580194 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580291 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580491 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580578 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580792 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.580878 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.581087 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.581181 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.581396 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.581484 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.581692 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.581778 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582013 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582110 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582310 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582397 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582614 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582700 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582910 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.582997 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.583207 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.583301 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.583506 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.583592 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.583803 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.583897 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584104 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584189 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584397 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584489 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584698 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584785 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.584994 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.585078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.585300 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.585396 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.585598 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.585685 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.585923 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586012 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586229 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586326 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586540 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586629 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586846 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.586940 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.587151 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.587246 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.587460 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.587554 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.587765 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.587852 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588078 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588174 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588383 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588508 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588687 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588816 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.588995 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.589081 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.589316 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.589404 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.589630 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.589866 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.589971 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.590196 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.590283 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.590516 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.590610 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.590846 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.591123 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.591210 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.591461 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.591547 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.591761 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.591847 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.592063 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.592151 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.592643 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.592729 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.592948 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593048 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593254 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593341 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593559 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593645 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593886 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.593991 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.594195 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.594283 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.594534 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.594871 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.594959 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.595185 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.595274 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.595496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.595583 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.595807 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.595902 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.596114 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.596201 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.596417 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.596503 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.596722 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.596817 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597026 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597115 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597331 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597427 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597640 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597785 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.597974 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.598063 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.598285 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.598381 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.598603 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.598690 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.598944 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599031 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599263 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599349 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599569 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599663 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599875 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.599969 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.600180 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.600267 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.600484 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.600580 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.600793 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.600887 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.601103 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.601189 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.601414 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.601500 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.601716 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.601810 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.602070 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.602169 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.602447 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.602541 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.602762 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.602848 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.603076 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.603191 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.603382 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.603506 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.603698 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.603825 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604015 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604146 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604321 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604457 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604633 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604779 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.604944 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.605103 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.605266 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.605413 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.605598 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.605734 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.605941 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.606081 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.606260 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.606408 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.606561 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.606746 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.606862 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.607078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.607164 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.607403 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.607490 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.607710 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.607838 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608017 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608103 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608321 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608407 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608618 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608704 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.608921 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609009 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609220 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609306 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609516 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609604 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609869 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.609962 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.610655 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.610767 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.610963 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611057 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611277 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611369 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611593 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611694 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611895 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.611983 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.612195 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.612290 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.612492 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.612588 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.612790 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.612876 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.613094 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.613182 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.613390 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.613490 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.613690 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.613776 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614010 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614097 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614311 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614408 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614611 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614698 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614913 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.614999 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.615218 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.615312 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.615523 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.615610 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.615826 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.615913 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.616144 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.616230 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.616458 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.616552 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.616763 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.616850 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.617077 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.617203 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.617387 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.617473 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.617696 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.617791 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618024 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618113 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618345 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618431 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618651 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618745 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.618958 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619045 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619265 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619354 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619571 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619670 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619877 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.619964 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.620225 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.620318 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.620490 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.620590 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.620803 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.620897 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.621103 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.621189 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.621413 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.621500 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.621725 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.621854 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622062 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622150 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622365 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622453 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622669 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622754 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.622992 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.623079 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.623298 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.623394 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.623605 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.623692 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.623910 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624006 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624216 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624304 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624520 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624607 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624829 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.624928 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.625132 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.625217 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.625439 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.625525 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.625774 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.625907 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.626142 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.626229 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.626456 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.626542 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.626767 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.626855 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.627070 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.627155 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.627389 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.627475 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.627709 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.627802 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628032 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628125 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628342 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628427 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628665 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628760 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.628989 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.629075 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.629299 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.629386 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.629604 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.629692 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.629990 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.630085 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.630238 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 12:41:37.630339 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.630627 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.630938 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.631246 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:41:37.631490 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 12:41:37.783488 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO dbcounter [None req-7707754b-f726-4711-8b42-57495de3578c None None] Registered counter for database nova_api Jul 29 12:41:37.784298 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO dbcounter [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Registered counter for database nova_api Jul 29 12:41:37.804303 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_db.sqlalchemy.engines [None req-7707754b-f726-4711-8b42-57495de3578c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:37.806084 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_db.sqlalchemy.engines [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:37.810990 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writer thread running {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:37.812540 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writer thread running {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:37.866275 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.context [None req-7707754b-f726-4711-8b42-57495de3578c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),700a5828-9678-4497-a9ca-54189636954d(cell1) {{(pid=114827) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 12:41:37.868529 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.context [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),700a5828-9678-4497-a9ca-54189636954d(cell1) {{(pid=114826) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 12:41:37.870212 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_concurrency.lockutils [None req-7707754b-f726-4711-8b42-57495de3578c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:41:37.871848 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_concurrency.lockutils [None req-7707754b-f726-4711-8b42-57495de3578c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:41:37.872482 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:41:37.872609 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_concurrency.lockutils [None req-7707754b-f726-4711-8b42-57495de3578c None None] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:41:37.874083 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:41:37.874522 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_concurrency.lockutils [None req-7707754b-f726-4711-8b42-57495de3578c None None] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:41:37.874887 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:41:37.877006 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO dbcounter [None req-7707754b-f726-4711-8b42-57495de3578c None None] Registered counter for database nova_cell0 Jul 29 12:41:37.877382 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:41:37.879393 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO dbcounter [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Registered counter for database nova_cell0 Jul 29 12:41:37.882384 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO dbcounter [None req-7707754b-f726-4711-8b42-57495de3578c None None] Registered counter for database nova_cell1 Jul 29 12:41:37.884734 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO dbcounter [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Registered counter for database nova_cell1 Jul 29 12:41:37.889773 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_db.sqlalchemy.engines [None req-7707754b-f726-4711-8b42-57495de3578c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:37.891140 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_db.sqlalchemy.engines [None req-7707754b-f726-4711-8b42-57495de3578c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:37.894705 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_db.sqlalchemy.engines [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:37.897795 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writer thread running {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:37.898568 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_db.sqlalchemy.engines [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:37.900567 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writer thread running {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:37.900679 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writer thread running {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:38.040103 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writer thread running {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:38.047949 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO dbcounter [None req-7707754b-f726-4711-8b42-57495de3578c None None] Registered counter for database nova_cell0 Jul 29 12:41:38.048837 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO dbcounter [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Registered counter for database nova_cell0 Jul 29 12:41:38.057037 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG oslo_db.sqlalchemy.engines [None req-7707754b-f726-4711-8b42-57495de3578c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:38.060728 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_db.sqlalchemy.engines [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:41:38.061694 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writer thread running {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:38.065137 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writer thread running {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:41:38.398851 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: WARNING keystonemiddleware.auth_token [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:41:38.399550 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: WARNING keystonemiddleware.auth_token [None req-7707754b-f726-4711-8b42-57495de3578c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:41:38.406160 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: WARNING keystonemiddleware.auth_token [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:41:38.406277 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: WARNING keystonemiddleware.auth_token [None req-7707754b-f726-4711-8b42-57495de3578c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:41:38.748467 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: WARNING keystonemiddleware.auth_token [None req-7707754b-f726-4711-8b42-57495de3578c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:41:38.755109 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: WARNING keystonemiddleware.auth_token [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:41:38.756597 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: WARNING keystonemiddleware.auth_token [None req-7707754b-f726-4711-8b42-57495de3578c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:41:38.761064 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: WARNING keystonemiddleware.auth_token [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:41:38.762876 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da0cf019c0 pid: 114827 (default app) Jul 29 12:41:38.764967 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-7707754b-f726-4711-8b42-57495de3578c None None] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:41:38.766176 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-7707754b-f726-4711-8b42-57495de3578c None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jul 29 12:41:38.766430 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da0cf019c0 pid: 114826 (default app) Jul 29 12:41:38.766638 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Fri Jul 29 12:41:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:42:54.515889 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:42:54.517091 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Jul 29 12:42:54.517548 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:42:54.528509 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writing DB stats nova_api:SELECT=3 {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:54.529475 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writing DB stats nova_cell0:SELECT=3 {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:54.530463 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writing DB stats nova_cell1:SELECT=3 {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:54.531409 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:55.392324 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-7718bb7d-8582-486b-a726-f2673f5babe1 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:42:55.425190 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-7718bb7d-8582-486b-a726-f2673f5babe1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901414 Jul 29 12:42:55.433837 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 29 12:42:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:42:57.652588 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:42:57.653687 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-45ff2bc8-0526-4712-92a6-6751018bc237 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 29 12:42:57.657943 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 2/4] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:42:58.134629 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-15d1ef27-794c-4538-bc12-f651062c7b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:42:58.155414 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:42:58.155414 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: warnings.warn(msg) Jul 29 12:42:58.183515 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-15d1ef27-794c-4538-bc12-f651062c7b10 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.522635 Jul 29 12:42:58.184029 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 3/5] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:42:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:42:58.406894 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-b53796f2-2ec2-4628-9d1a-847ebad02154 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:42:58.411871 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:42:58.411871 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: warnings.warn(msg) Jul 29 12:42:58.428059 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_api:SELECT=3 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:58.428799 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_cell0:SELECT=3 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:58.429238 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_cell1:SELECT=3 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:58.429947 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:42:58.478579 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-b53796f2-2ec2-4628-9d1a-847ebad02154 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285968 Jul 29 12:42:58.479174 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 3/6] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 29 12:42:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:00.731762 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-15d1ef27-794c-4538-bc12-f651062c7b10 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:00.733320 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-15d1ef27-794c-4538-bc12-f651062c7b10 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Jul 29 12:43:00.733918 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 4/7] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:01.403226 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-728e2df9-d541-4c96-83bb-ac51f256328c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:01.423003 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:43:01.423003 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: warnings.warn(msg) Jul 29 12:43:01.443529 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-728e2df9-d541-4c96-83bb-ac51f256328c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703803 Jul 29 12:43:01.444452 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 4/8] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:43:01.457495 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-15e675d3-e1e5-41cb-8bac-4094e351ceb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:01.461012 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:43:01.461012 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: warnings.warn(msg) Jul 29 12:43:01.502751 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-15e675d3-e1e5-41cb-8bac-4094e351ceb8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049134 Jul 29 12:43:01.503803 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 5/9] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 29 12:43:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:03.743736 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-728e2df9-d541-4c96-83bb-ac51f256328c admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:03.744742 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-728e2df9-d541-4c96-83bb-ac51f256328c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 29 12:43:03.745088 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:04.155621 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-72aadd00-02bb-4a63-b1d3-128f9e75d7fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 1024}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:04.174788 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-72aadd00-02bb-4a63-b1d3-128f9e75d7fb admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423475 Jul 29 12:43:04.175243 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 6/11] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:04.187865 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-b09c3a6e-e9a6-4eb6-aaad-631ea513ec3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:04.210101 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-b09c3a6e-e9a6-4eb6-aaad-631ea513ec3a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026779 Jul 29 12:43:04.210671 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 6/12] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 29 12:43:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:06.399412 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-72aadd00-02bb-4a63-b1d3-128f9e75d7fb admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:06.400360 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-72aadd00-02bb-4a63-b1d3-128f9e75d7fb admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 29 12:43:06.400761 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:06.811591 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-b7a112ea-2f90-4fd9-b541-f3b0381358fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:06.830179 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-b7a112ea-2f90-4fd9-b541-f3b0381358fa admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422894 Jul 29 12:43:06.830730 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 7/14] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:43:06.842715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-836f0e87-ba7c-4a39-9cb0-d7ec1e88aecd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:06.872138 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-836f0e87-ba7c-4a39-9cb0-d7ec1e88aecd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029301 Jul 29 12:43:06.872138 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 8/15] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 29 12:43:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:09.114361 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-b7a112ea-2f90-4fd9-b541-f3b0381358fa admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:09.116016 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-b7a112ea-2f90-4fd9-b541-f3b0381358fa admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Jul 29 12:43:09.116566 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 8/16] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:09.545101 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-7915bdd0-0f89-49e8-bf85-f730f7f33d72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:09.566057 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-7915bdd0-0f89-49e8-bf85-f730f7f33d72 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441276 Jul 29 12:43:09.570214 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 9/17] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:09.580155 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-deb189df-fcf1-4fb0-a707-98b84de1887b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:09.608509 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-deb189df-fcf1-4fb0-a707-98b84de1887b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033607 Jul 29 12:43:09.609094 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 9/18] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 29 12:43:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:11.972654 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-7915bdd0-0f89-49e8-bf85-f730f7f33d72 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:11.973734 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-7915bdd0-0f89-49e8-bf85-f730f7f33d72 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jul 29 12:43:11.974273 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 10/19] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:12.460530 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-4694adac-1d5e-412e-82a7-31f2d4dbb8b9 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:12.492796 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-4694adac-1d5e-412e-82a7-31f2d4dbb8b9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.512460 Jul 29 12:43:12.493622 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 10/20] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 29 12:43:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:43:14.694734 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-7915bdd0-0f89-49e8-bf85-f730f7f33d72 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:14.695935 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-7915bdd0-0f89-49e8-bf85-f730f7f33d72 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Jul 29 12:43:14.696314 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:15.132656 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-697ac825-ca6e-4bd6-8e02-6c5a64992905 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "name": "m1.tiny", "swap": 0}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:15.155594 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-697ac825-ca6e-4bd6-8e02-6c5a64992905 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452689 Jul 29 12:43:15.156457 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 11/22] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:15.168636 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-3c0e534b-9da6-42ca-a67d-eaaf466c1a97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:15.192879 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-3c0e534b-9da6-42ca-a67d-eaaf466c1a97 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028046 Jul 29 12:43:15.193443 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 12/23] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 29 12:43:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:17.409241 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-697ac825-ca6e-4bd6-8e02-6c5a64992905 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:17.410321 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-697ac825-ca6e-4bd6-8e02-6c5a64992905 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 29 12:43:17.410729 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:17.808470 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-b56e1cd7-335b-4106-95ef-29cec8221ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 20, "name": "m1.small"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:17.828330 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-b56e1cd7-335b-4106-95ef-29cec8221ba6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411656 Jul 29 12:43:17.828876 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 13/25] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:43:17.840571 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-e9e1eac2-61d2-4eb1-bc6b-61b0a62f389f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:17.864745 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-e9e1eac2-61d2-4eb1-bc6b-61b0a62f389f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027740 Jul 29 12:43:17.865317 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 13/26] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 29 12:43:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:20.063582 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-b56e1cd7-335b-4106-95ef-29cec8221ba6 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:20.064590 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-b56e1cd7-335b-4106-95ef-29cec8221ba6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 29 12:43:20.064997 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:20.436272 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-4b43fc5e-cf46-437b-9512-293f9023b4be admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3"}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:20.455533 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-4b43fc5e-cf46-437b-9512-293f9023b4be admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.384638 Jul 29 12:43:20.456085 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 14/28] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:43:20.469690 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-37d6157e-675d-4b2e-9187-59fb1759cb47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:20.493254 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-37d6157e-675d-4b2e-9187-59fb1759cb47 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029051 Jul 29 12:43:20.493849 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 15/29] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 29 12:43:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:43:22.737942 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-4b43fc5e-cf46-437b-9512-293f9023b4be admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:22.739024 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-4b43fc5e-cf46-437b-9512-293f9023b4be admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 29 12:43:22.739433 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 15/30] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:23.201313 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-8c077a09-f3f2-42c5-b320-01ec37e9a02d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "ram": 8192, "name": "m1.large"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:23.223190 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-8c077a09-f3f2-42c5-b320-01ec37e9a02d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.477689 Jul 29 12:43:23.224094 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 16/31] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:23.237275 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-30b257dd-179f-49bc-ab3a-3d10ed573138 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:23.265644 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-30b257dd-179f-49bc-ab3a-3d10ed573138 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032745 Jul 29 12:43:23.266264 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 29 12:43:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:25.525606 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-8c077a09-f3f2-42c5-b320-01ec37e9a02d admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:25.526760 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-8c077a09-f3f2-42c5-b320-01ec37e9a02d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 29 12:43:25.527636 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:25.961979 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-fd95c8f7-e6f9-40bd-8f6b-454556dfd665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:25.982433 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-fd95c8f7-e6f9-40bd-8f6b-454556dfd665 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449013 Jul 29 12:43:25.990193 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 17/34] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 29 12:43:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:25.995477 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-d4062c4a-77ec-46a5-a5d3-bf4612438501 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:26.002191 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:43:26.022579 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-d4062c4a-77ec-46a5-a5d3-bf4612438501 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031045 Jul 29 12:43:26.023171 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 18/35] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 29 12:43:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:43:46.006969 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-fd95c8f7-e6f9-40bd-8f6b-454556dfd665 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:46.007989 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-fd95c8f7-e6f9-40bd-8f6b-454556dfd665 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 29 12:43:46.008392 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 18/36] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:46.407411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-9b824c57-f4b0-44ce-94b0-b3100d4d669f admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:46.425120 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-9b824c57-f4b0-44ce-94b0-b3100d4d669f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410518 Jul 29 12:43:46.425657 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 29 12:43:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:43:47.489270 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-fd95c8f7-e6f9-40bd-8f6b-454556dfd665 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:47.490311 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-fd95c8f7-e6f9-40bd-8f6b-454556dfd665 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 29 12:43:47.490713 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 19/38] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:48.004875 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-9129a43a-3ac9-414e-bff3-7a2427e9295b admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:48.010500 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.wsgi [None req-9129a43a-3ac9-414e-bff3-7a2427e9295b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-9129a43a-3ac9-414e-bff3-7a2427e9295b admin admin] Request method failure captured: Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Accept: application/json Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Accept-Encoding: gzip, deflate Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Connection: keep-alive Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Content-Length: 0 Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Host: 10.222.0.66 Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Openstack-Api-Version: compute 2.90 Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Openstack-System-Scope: None Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: User-Agent: python-novaclient Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Auth-Token: gAAAAABi49YDhvX31iyGzhR34FiQn3RlO-GeDvoL7q7m-E65wafn_tR1wRM3S4CK9mhu4YutUt2oPnkpqlDN_Ti3WaR9nLS50iRRFeIujGrwV2I0rE-AyN8_8N5iE_a9eQRczQd_CUQqaPWaABtByd_pO9SI7zXhUPGnGxTnOU4CPt6-xrgo0xY Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Domain-Id: None Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Domain-Name: None Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Identity-Status: Confirmed Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Is-Admin-Project: True Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Domain-Id: default Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Domain-Name: Default Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Name: admin Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Role: reader,admin,member Jul 29 12:43:48.013715 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Roles: reader,admin,member Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant: admin Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant-Name: admin Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User: admin Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Domain-Id: default Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Domain-Name: Default Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Id: 1eea4fac81544f2bac9c90f3a5feb407 Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Name: admin Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: method: > Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: exception: Flavor 42 could not be found. Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: action_args: {'id': '42'} Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:43:48.015411 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:48.016362 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.017478 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-9129a43a-3ac9-414e-bff3-7a2427e9295b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:43:48.018587 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-9129a43a-3ac9-414e-bff3-7a2427e9295b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389662 Jul 29 12:43:48.018587 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 20/39] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 29 12:43:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 12:43:48.024928 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-f8d99458-4c8e-42e7-afcf-cb547e48b251 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:48.029170 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:43:48.049281 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-f8d99458-4c8e-42e7-afcf-cb547e48b251 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028005 Jul 29 12:43:48.049891 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 20/40] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 29 12:43:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:43:48.060211 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-868a26dc-ab42-4ac5-a600-99c5b19997e1 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:48.083900 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-868a26dc-ab42-4ac5-a600-99c5b19997e1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027876 Jul 29 12:43:48.084434 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 29 12:43:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:43:48.094722 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-a192aa61-6d55-4a2f-91a0-a04489ff1a0d admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:48.103627 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.wsgi [None req-a192aa61-6d55-4a2f-91a0-a04489ff1a0d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-a192aa61-6d55-4a2f-91a0-a04489ff1a0d admin admin] Request method failure captured: Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Accept: application/json Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Accept-Encoding: gzip, deflate Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Connection: keep-alive Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Content-Length: 0 Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Host: 10.222.0.66 Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Openstack-Api-Version: compute 2.90 Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Openstack-System-Scope: None Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: User-Agent: python-novaclient Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Auth-Token: gAAAAABi49YDhvX31iyGzhR34FiQn3RlO-GeDvoL7q7m-E65wafn_tR1wRM3S4CK9mhu4YutUt2oPnkpqlDN_Ti3WaR9nLS50iRRFeIujGrwV2I0rE-AyN8_8N5iE_a9eQRczQd_CUQqaPWaABtByd_pO9SI7zXhUPGnGxTnOU4CPt6-xrgo0xY Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Domain-Id: None Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Domain-Name: None Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Identity-Status: Confirmed Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Is-Admin-Project: True Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Domain-Id: default Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Domain-Name: Default Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Name: admin Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Role: reader,admin,member Jul 29 12:43:48.108890 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Roles: reader,admin,member Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant: admin Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant-Name: admin Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User: admin Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Domain-Id: default Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Domain-Name: Default Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Id: 1eea4fac81544f2bac9c90f3a5feb407 Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Name: admin Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: method: > Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: exception: Flavor 42 could not be found. Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: action_args: {'id': '42'} Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:43:48.110259 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:48.111033 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:48.112417 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-a192aa61-6d55-4a2f-91a0-a04489ff1a0d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:43:48.113672 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-a192aa61-6d55-4a2f-91a0-a04489ff1a0d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.020442 Jul 29 12:43:48.113672 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 21/42] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 29 12:43:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 12:43:49.080290 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-868a26dc-ab42-4ac5-a600-99c5b19997e1 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:49.081312 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-868a26dc-ab42-4ac5-a600-99c5b19997e1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 29 12:43:49.081708 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 22/43] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:49.606686 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-418c19aa-b79f-4614-9460-6723b6d72029 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:49.612007 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.wsgi [None req-418c19aa-b79f-4614-9460-6723b6d72029 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-418c19aa-b79f-4614-9460-6723b6d72029 admin admin] Request method failure captured: Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Accept: application/json Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Accept-Encoding: gzip, deflate Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Connection: keep-alive Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Content-Length: 0 Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Host: 10.222.0.66 Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Openstack-Api-Version: compute 2.90 Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Openstack-System-Scope: None Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: User-Agent: python-novaclient Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Auth-Token: gAAAAABi49YEeqM3aGQyh-8AS3wzcL8z6LoNUarOxADMbrbSLxOFxdP3TVO8gyEr-8rQ8m-qCPyGUEqtyShAzwj5qizMfN3lsXCQaPFNN1iQwT9QSwO-aWExH0jBWvWLgH9YJRpPUpEkgugVG9x_Qoym09K1TKqxbHhakOq7XJhvD8n1rL9v5kg Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Domain-Id: None Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Domain-Name: None Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Identity-Status: Confirmed Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Is-Admin-Project: True Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Domain-Id: default Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Domain-Name: Default Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Name: admin Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Role: reader,admin,member Jul 29 12:43:49.613496 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Roles: reader,admin,member Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant: admin Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant-Name: admin Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User: admin Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Domain-Id: default Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Domain-Name: Default Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Id: 1eea4fac81544f2bac9c90f3a5feb407 Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Name: admin Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: method: > Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: exception: Flavor 84 could not be found. Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: action_args: {'id': '84'} Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:43:49.615001 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:49.615992 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.617078 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-418c19aa-b79f-4614-9460-6723b6d72029 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:43:49.618109 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-418c19aa-b79f-4614-9460-6723b6d72029 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393310 Jul 29 12:43:49.618109 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 29 12:43:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 12:43:49.624552 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-909377de-6d7d-43f2-9a22-becdf8e17dfa admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:49.640198 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-909377de-6d7d-43f2-9a22-becdf8e17dfa admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019159 Jul 29 12:43:49.640737 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 29 12:43:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:43:49.650360 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-38301cec-4483-4d58-9327-6963090be3e7 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:49.667423 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-38301cec-4483-4d58-9327-6963090be3e7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020595 Jul 29 12:43:49.667952 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 29 12:43:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:43:49.677583 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-d6ca1fa7-a322-4d6c-a07d-4ec69db1ead6 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:49.682982 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.wsgi [None req-d6ca1fa7-a322-4d6c-a07d-4ec69db1ead6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-d6ca1fa7-a322-4d6c-a07d-4ec69db1ead6 admin admin] Request method failure captured: Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Accept: application/json Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Accept-Encoding: gzip, deflate Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Connection: keep-alive Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Content-Length: 0 Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Host: 10.222.0.66 Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Openstack-Api-Version: compute 2.90 Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Openstack-System-Scope: None Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: User-Agent: python-novaclient Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Auth-Token: gAAAAABi49YEeqM3aGQyh-8AS3wzcL8z6LoNUarOxADMbrbSLxOFxdP3TVO8gyEr-8rQ8m-qCPyGUEqtyShAzwj5qizMfN3lsXCQaPFNN1iQwT9QSwO-aWExH0jBWvWLgH9YJRpPUpEkgugVG9x_Qoym09K1TKqxbHhakOq7XJhvD8n1rL9v5kg Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Domain-Id: None Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Domain-Name: None Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Identity-Status: Confirmed Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Is-Admin-Project: True Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Domain-Id: default Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Domain-Name: Default Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Name: admin Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Role: reader,admin,member Jul 29 12:43:49.685067 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Roles: reader,admin,member Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant: admin Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant-Name: admin Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User: admin Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Domain-Id: default Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Domain-Name: Default Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Id: 1eea4fac81544f2bac9c90f3a5feb407 Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Name: admin Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: method: > Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: exception: Flavor 84 could not be found. Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: action_args: {'id': '84'} Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:43:49.686592 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:49.687510 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:49.688645 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-d6ca1fa7-a322-4d6c-a07d-4ec69db1ead6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:43:49.689685 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-d6ca1fa7-a322-4d6c-a07d-4ec69db1ead6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012344 Jul 29 12:43:49.689685 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 29 12:43:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 12:43:50.680623 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-38301cec-4483-4d58-9327-6963090be3e7 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:50.681619 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-38301cec-4483-4d58-9327-6963090be3e7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 29 12:43:50.682044 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 24/48] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:51.205951 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-07f1ae40-b119-40a2-82e9-18f9ad72123b admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:51.212368 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.wsgi [None req-07f1ae40-b119-40a2-82e9-18f9ad72123b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-07f1ae40-b119-40a2-82e9-18f9ad72123b admin admin] Request method failure captured: Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Accept: application/json Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Accept-Encoding: gzip, deflate Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Connection: keep-alive Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Content-Length: 0 Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Host: 10.222.0.66 Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Openstack-Api-Version: compute 2.90 Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Openstack-System-Scope: None Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: User-Agent: python-novaclient Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Auth-Token: gAAAAABi49YGi4ZEtNdRVAqlWzpbr33iE6Dkc3BlY9JyRiduxElfw9VWqKODpp-PrEqZWXpT42LZcojgM4r_-4vQFR3A5X086S39KypR3oPXBU3WXH_RJqX0_4d6vE-ZGqcaPvUE9q61hTMtRZoPGyXIyQMpYHcSuMZkY4KI62I5PDxyucQvzDI Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Domain-Id: None Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Domain-Name: None Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Identity-Status: Confirmed Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Is-Admin-Project: True Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Domain-Id: default Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Domain-Name: Default Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Project-Name: admin Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Role: reader,admin,member Jul 29 12:43:51.214224 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Roles: reader,admin,member Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant: admin Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-Tenant-Name: admin Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User: admin Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Domain-Id: default Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Domain-Name: Default Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Id: 1eea4fac81544f2bac9c90f3a5feb407 Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: X-User-Name: admin Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: method: > Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: exception: Flavor 451 could not be found. Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: action_args: {'id': '451'} Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:43:51.215668 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:51.216485 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.217954 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-07f1ae40-b119-40a2-82e9-18f9ad72123b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:43:51.219427 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-07f1ae40-b119-40a2-82e9-18f9ad72123b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397513 Jul 29 12:43:51.219427 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 29 12:43:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 12:43:51.226591 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-83cb7058-9604-4c31-a9a5-3205ddd3422f admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:51.241181 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-83cb7058-9604-4c31-a9a5-3205ddd3422f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018121 Jul 29 12:43:51.241705 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 25/50] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 29 12:43:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:43:51.251463 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:51.267256 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019332 Jul 29 12:43:51.267787 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 26/51] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 29 12:43:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:43:51.276734 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-9c936357-d3cd-42cf-8b9e-014c8a025327 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:51.282026 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.wsgi [None req-9c936357-d3cd-42cf-8b9e-014c8a025327 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-9c936357-d3cd-42cf-8b9e-014c8a025327 admin admin] Request method failure captured: Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Accept: application/json Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Accept-Encoding: gzip, deflate Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Connection: keep-alive Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Content-Length: 0 Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Host: 10.222.0.66 Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Openstack-Api-Version: compute 2.90 Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Openstack-System-Scope: None Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: User-Agent: python-novaclient Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Auth-Token: gAAAAABi49YGi4ZEtNdRVAqlWzpbr33iE6Dkc3BlY9JyRiduxElfw9VWqKODpp-PrEqZWXpT42LZcojgM4r_-4vQFR3A5X086S39KypR3oPXBU3WXH_RJqX0_4d6vE-ZGqcaPvUE9q61hTMtRZoPGyXIyQMpYHcSuMZkY4KI62I5PDxyucQvzDI Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Domain-Id: None Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Domain-Name: None Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Identity-Status: Confirmed Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Is-Admin-Project: True Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Domain-Id: default Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Domain-Name: Default Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Project-Name: admin Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Role: reader,admin,member Jul 29 12:43:51.283501 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Roles: reader,admin,member Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5a5cdc1deb42199be2e349eba98664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant: admin Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant-Id: 9e5a5cdc1deb42199be2e349eba98664 Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-Tenant-Name: admin Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User: admin Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Domain-Id: default Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Domain-Name: Default Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Id: 1eea4fac81544f2bac9c90f3a5feb407 Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: X-User-Name: admin Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: method: > Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: exception: Flavor 451 could not be found. Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: action_args: {'id': '451'} Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:43:51.285119 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:51.286167 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: ERROR nova.api.openstack.wsgi Jul 29 12:43:51.287487 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-9c936357-d3cd-42cf-8b9e-014c8a025327 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:43:51.288727 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-9c936357-d3cd-42cf-8b9e-014c8a025327 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011570 Jul 29 12:43:51.288933 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 26/52] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 29 12:43:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 12:43:52.260534 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:52.261553 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 29 12:43:52.262003 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:52.805813 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-bbe82371-2746-4758-8874-6aec7e3837ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:52.825957 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-bbe82371-2746-4758-8874-6aec7e3837ef admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.418234 Jul 29 12:43:52.826510 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 27/54] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 29 12:43:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:53.809104 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:53.810168 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 29 12:43:53.810612 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:54.333775 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-d9e1eeb6-eb33-4f49-84d9-120a292fd7ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:54.353217 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-d9e1eeb6-eb33-4f49-84d9-120a292fd7ba admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403944 Jul 29 12:43:54.353886 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 28/56] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 29 12:43:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:55.333535 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:55.334663 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jul 29 12:43:55.335163 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 29/57] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:55.856318 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-1cf1cce4-a0e1-4feb-b02b-7db76e7ca0f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:55.875583 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-1cf1cce4-a0e1-4feb-b02b-7db76e7ca0f4 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401523 Jul 29 12:43:55.876127 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 29/58] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 29 12:43:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:43:56.828254 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:56.829262 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 29 12:43:56.829654 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 30/59] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:57.354016 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-a8f21e0b-959a-41e6-84b6-59275a360db6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:43:57.372874 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-a8f21e0b-959a-41e6-84b6-59275a360db6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407831 Jul 29 12:43:57.373424 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 30/60] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 29 12:43:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:43:58.342288 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:58.343572 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Jul 29 12:43:58.343977 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 31/61] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:43:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:43:58.869939 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-44b80c13-2074-4877-a1b0-557fc2318a76 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:43:58.890009 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-44b80c13-2074-4877-a1b0-557fc2318a76 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404986 Jul 29 12:43:58.890549 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1202 bytes} [Fri Jul 29 12:43:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:44:50.471201 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:44:50.472249 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-e608ac4a-c0bd-4706-8176-b892697eba30 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 29 12:44:50.472654 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 29 12:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:44:50.479520 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:44:50.870284 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-206ae232-9498-41ae-add7-bc137b045244 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:44:50.890420 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-206ae232-9498-41ae-add7-bc137b045244 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411737 Jul 29 12:44:50.890963 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 32/64] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 29 12:44:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:44:50.914610 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-ad0633e8-a708-486c-b452-1fb2cdae8425 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:44:50.918737 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG dbcounter [-] [114827] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=114827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:44:50.923967 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-ad0633e8-a708-486c-b452-1fb2cdae8425 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014020 Jul 29 12:44:50.924520 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 33/65] 10.222.0.66 () {60 vars in 1282 bytes} [Fri Jul 29 12:44:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:44:50.936201 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-e90809f7-4b11-4932-bb77-7c0ba064102a admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:44:50.943846 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-e90809f7-4b11-4932-bb77-7c0ba064102a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011338 Jul 29 12:44:50.944405 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1285 bytes} [Fri Jul 29 12:44:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:44:50.956546 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:44:50.965624 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012882 Jul 29 12:44:50.966181 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 34/67] 10.222.0.66 () {60 vars in 1285 bytes} [Fri Jul 29 12:44:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:44:50.977537 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-e74a1202-fa76-4941-a4c3-e1425b55f612 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:44:50.984998 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-e74a1202-fa76-4941-a4c3-e1425b55f612 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011085 Jul 29 12:44:50.985509 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 34/68] 10.222.0.66 () {60 vars in 1282 bytes} [Fri Jul 29 12:44:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:48:12.341073 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:12.342116 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 29 12:48:12.342517 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 35/69] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:48:12.484778 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_api:SELECT=6 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:48:12.645794 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-419ccf43-c03f-492d-9b4b-cd0124195886 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:12.648144 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:48:12.648144 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: warnings.warn(msg) Jul 29 12:48:12.649383 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-419ccf43-c03f-492d-9b4b-cd0124195886 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:12.649846 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-419ccf43-c03f-492d-9b4b-cd0124195886 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:12.650633 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-419ccf43-c03f-492d-9b4b-cd0124195886 admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:12.651065 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-419ccf43-c03f-492d-9b4b-cd0124195886 admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:12.685840 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-419ccf43-c03f-492d-9b4b-cd0124195886 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.202595 Jul 29 12:48:12.686490 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 35/70] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 29 12:48:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:48:13.510084 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:13.511081 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 29 12:48:13.511473 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:48:13.699560 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-d13b7950-7d0b-43eb-b683-3d245b27a53c admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:13.702132 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:48:13.702132 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: warnings.warn(msg) Jul 29 12:48:13.703432 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-d13b7950-7d0b-43eb-b683-3d245b27a53c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:13.703915 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-d13b7950-7d0b-43eb-b683-3d245b27a53c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:13.704795 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-d13b7950-7d0b-43eb-b683-3d245b27a53c admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:13.705255 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-d13b7950-7d0b-43eb-b683-3d245b27a53c admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:13.727532 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-d13b7950-7d0b-43eb-b683-3d245b27a53c admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078798 Jul 29 12:48:13.728058 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 36/72] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 29 12:48:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:48:24.982100 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:24.983147 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 29 12:48:24.983555 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 37/73] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:48:25.126884 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_cell0:SELECT=4 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:48:25.127648 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_cell1:SELECT=4 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:48:25.128243 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG dbcounter [-] [114826] Writing DB stats nova_api:SELECT=8 {{(pid=114826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:48:25.179114 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-1c9f8977-a3b3-4e79-8853-70ab48fa8bc3 admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:25.181973 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:48:25.181973 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: warnings.warn(msg) Jul 29 12:48:25.183141 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-1c9f8977-a3b3-4e79-8853-70ab48fa8bc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:25.183578 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-1c9f8977-a3b3-4e79-8853-70ab48fa8bc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:25.184349 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-1c9f8977-a3b3-4e79-8853-70ab48fa8bc3 admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:25.184772 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-1c9f8977-a3b3-4e79-8853-70ab48fa8bc3 admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:25.211477 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-1c9f8977-a3b3-4e79-8853-70ab48fa8bc3 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088913 Jul 29 12:48:25.212125 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 37/74] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 29 12:48:25 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:48:26.051179 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: DEBUG nova.api.openstack.wsgi [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] Calling method '>' {{(pid=114827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:26.052189 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: INFO nova.api.openstack.requestlog [None req-298601ad-4dcb-4d57-8e6c-0dcee12532a4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Jul 29 12:48:26.052598 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: [pid: 114827|app: 0|req: 38/75] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 29 12:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:48:26.245529 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG nova.api.openstack.wsgi [None req-41294bb2-2bdd-4f15-8fe5-e4344c319cfa admin admin] Calling method '>' {{(pid=114826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:48:26.247920 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 12:48:26.247920 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: warnings.warn(msg) Jul 29 12:48:26.249185 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-41294bb2-2bdd-4f15-8fe5-e4344c319cfa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:26.249623 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-41294bb2-2bdd-4f15-8fe5-e4344c319cfa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:26.250436 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-41294bb2-2bdd-4f15-8fe5-e4344c319cfa admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:48:26.250866 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: DEBUG oslo_concurrency.lockutils [None req-41294bb2-2bdd-4f15-8fe5-e4344c319cfa admin admin] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:48:26.272770 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: INFO nova.api.openstack.requestlog [None req-41294bb2-2bdd-4f15-8fe5-e4344c319cfa admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079945 Jul 29 12:48:26.273262 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: [pid: 114826|app: 0|req: 38/76] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 29 12:48:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:49:22.297662 dv-cinder-819149-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 12:49:22.299290 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: Fri Jul 29 12:49:22 2022 - graceful shutdown triggered... Jul 29 12:49:22.299778 dv-cinder-819149-16-iscsi devstack@n-api.service[114826]: Gracefully killing worker 1 (pid: 114826)... Jul 29 12:49:22.300243 dv-cinder-819149-16-iscsi devstack@n-api.service[114827]: Gracefully killing worker 2 (pid: 114827)... Jul 29 12:49:23.299247 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: worker 1 buried after 1 seconds Jul 29 12:49:23.299445 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: worker 2 buried after 1 seconds Jul 29 12:49:23.299445 dv-cinder-819149-16-iscsi devstack@n-api.service[114825]: goodbye to uWSGI. Jul 29 12:49:23.300847 dv-cinder-819149-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 12:49:23.301391 dv-cinder-819149-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 12:49:23.304183 dv-cinder-819149-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 12:49:23.314183 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 12:49:23 2022] *** Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: nodename: dv-cinder-819149-16-iscsi Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: machine: x86_64 Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: clock source: unix Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: pcre jit disabled Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: detected number of CPU cores: 4 Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: current working directory: / Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: detected binary path: /usr/bin/uwsgi-core Jul 29 12:49:23.316179 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: your processes number limit is 47680 Jul 29 12:49:23.316871 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: your memory page size is 4096 bytes Jul 29 12:49:23.316871 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: detected max file descriptor number: 2048 Jul 29 12:49:23.316871 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: lock engine: pthread robust mutexes Jul 29 12:49:23.316871 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: thunder lock: enabled Jul 29 12:49:23.316871 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 12:49:23.316871 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 12:49:23.358955 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: Python main interpreter initialized at 0x55d9220849c0 Jul 29 12:49:23.358955 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: python threads support enabled Jul 29 12:49:23.358955 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: your server socket listen backlog is limited to 100 connections Jul 29 12:49:23.358955 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: your mercy for graceful operations on workers is 90 seconds Jul 29 12:49:23.359398 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 12:49:23.359398 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: *** Operational MODE: preforking *** Jul 29 12:49:23.359670 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: *** uWSGI is running in multiple interpreter mode *** Jul 29 12:49:23.359670 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: spawned uWSGI master process (pid: 129303) Jul 29 12:49:23.359899 dv-cinder-819149-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 12:49:23.361860 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: spawned uWSGI worker 1 (pid: 129323, cores: 1) Jul 29 12:49:23.362282 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: spawned uWSGI worker 2 (pid: 129324, cores: 1) Jul 29 12:49:23.362443 dv-cinder-819149-16-iscsi devstack@n-api.service[129303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 12:49:24.034302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 12:49:24.048924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 12:49:25.216859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:49:25.216859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: from cryptography.utils import int_from_bytes Jul 29 12:49:25.217594 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:49:25.217594 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: from cryptography.utils import int_from_bytes Jul 29 12:49:25.237604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:49:25.237604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: from cryptography.utils import int_from_bytes Jul 29 12:49:25.238209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 12:49:25.238209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: from cryptography.utils import int_from_bytes Jul 29 12:49:27.675574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 12:49:27.676101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 12:49:27.676432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 12:49:27.676790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 12:49:27.677089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 12:49:27.677490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.677886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.678221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.678579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.678921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.679270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.679600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.679961 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.680328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.680598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.680952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.681283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-16-iscsi {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.681658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.682208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.682568 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.682900 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.683246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.683581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.683895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.684408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.689872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-16-iscsi {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.690518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.691031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.691031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.691453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.691563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.692790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.692790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.692790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.692790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.693310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.693393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.693715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.694004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.694839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.694839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.694839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.695357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.695510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.695761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.696095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.696261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 12:49:27.696952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.697182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 12:49:27.697346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.697346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.697881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 12:49:27.698122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.698333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 12:49:27.698558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.698733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 12:49:27.698933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.699080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.699330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.699550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.699712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.699868 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.700998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.701143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.701294 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.701445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.701599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.701753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.701965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.702113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.702273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.702425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.702580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.702735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-16-iscsi {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.702899 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.703051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.703195 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.703195 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.704249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.704249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.705146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.706972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.707123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.707123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.707518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.707710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.707858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.708889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.709052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.709198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.709349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.709500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.709645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.709788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.710092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.710252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.710405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.710559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.710713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.710882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-16-iscsi {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.711938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.712081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.712238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.712390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.712546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.712698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.712860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.713013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.713157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.713301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.713478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.713985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.714149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.714303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.714449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.714609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.714771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.714919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.715082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.715254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.715561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.716053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.716309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.716470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.716616 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.716766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.716912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.717988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.718133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.718276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.718437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.718581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.718732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.718877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.719021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.719172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.719325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.719491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.719643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.720045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.720240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.720407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.720563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.720715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.720868 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.721969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.722124 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.722283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.722428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.722571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.725663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.726412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.726599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.726765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.726918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727693 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.727996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.728147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.728299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.728469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.728659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.728864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.729044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.729287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.729580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.729795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.729977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.730274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.730437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.730754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.731036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.731198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.731466 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.731704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.731858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.732059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.732059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.732671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.732918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.733402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.734877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.737701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.737969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.737969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.737969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.737969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.737969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.737969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.738982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.739936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.740089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.740241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.740444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.740611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.740756 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.740906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.741063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.741063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.741353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.741507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.741651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.741875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.742030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.742195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.742352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.742514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.742666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.742811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.742971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.743135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.743275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.743430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.743570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.743709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.743860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.744011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.744158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.744297 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.744446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.744585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.744745 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.744902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.745053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.745205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.745356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.745495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.745495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.745956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.746099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.746259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.746994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.747154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.747309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.747450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.747589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.747727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.747888 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.748040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.748192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 12:49:27.748355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.748496 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.748636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.748774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.748913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.748913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.749223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.749374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.749374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.750234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.750389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.750389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.750389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.750872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.751014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.751164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.751311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.751311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752589 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.752947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.753934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754832 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.754916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755657 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.755931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.756350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.756437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.756437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.756437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.757941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.758110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.758357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.758453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.758691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.758926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.759028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.759306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.759512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.759606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.759915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.760078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.760226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.760539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.760650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.760856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.761113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.761206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.761456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.761679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.761772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.762083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.762265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.762392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.762718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.762812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.763033 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.763301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.763401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.763635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.763864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.763967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.764275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.764443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.764585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.764925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.765019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.765266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.765479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.765579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.765934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.766064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.766254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.766544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.767823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.768151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.768243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.768469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.768704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.768807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.769094 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.769275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.769421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.769739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.769905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.770091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.770330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.770424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.770707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.770950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.771058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.771351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.771455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.771680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.771903 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.772006 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.772309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.772456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.772627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.772939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.773041 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.773252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.773488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.773590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.773891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.774088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.774222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.774539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.774659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.774865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.775143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.775249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.775648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.775817 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.776350 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.778374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.778374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.778897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.778998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.779096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.779254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.779358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.779358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.779358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.779940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.780519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.780633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.780929 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.781044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.781228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.781455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.781555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.782732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.782850 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783476 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.783930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.784017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.784110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.784423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.784537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.784751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.785003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.785098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.785385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.785574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.785746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.786869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.787927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.788983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.789225 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.789321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.789597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.789871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.790269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.790700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.791129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.792055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.792176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.792278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.792373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.792779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.793188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.793960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.794097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.794502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.794911 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.795316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.795700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.795801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.796017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.796272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.796535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.796785 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.797009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.797676 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.797789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.797983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.798083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.798934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.799195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.799652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.800060 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.800508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.800950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.801377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.801807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.802243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.802663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.803094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.803511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.803620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.803987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.804090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.804355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.804649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.804777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.805037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.805146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.805380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.805619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.805721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.806080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.806226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.806411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.806723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.806825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.807144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809888 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.809987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.810707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.811107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.811234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.811547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.811665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.811860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.812038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.812182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.812388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.812510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.812730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.812851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.813070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.813180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.813398 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.813503 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.813732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.813815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.814305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.814754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.815135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.815474 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.815814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.816162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.816477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.816802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.817116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.817428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.817741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.818193 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.818403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.818550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.818716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.818892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819899 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.819992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.820231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.820343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.820553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.820635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.820860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.820956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.821164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.821254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.821470 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.821556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.821779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.821924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.822131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.822228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.822445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.822549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.822768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.822851 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.823089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.823178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.823393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.823474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.823699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.823795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.824942 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.825031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.825244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.825334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.825588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.825678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.833852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.834943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.835879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.836763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.837138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.837138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.837712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.838101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.839688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.839808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.839808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.839988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840086 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.840959 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.841051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.841167 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.841348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.841498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.841658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.841847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.842105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.842422 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.842733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.843054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.843363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.843506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.843678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.843872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.843975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.844298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.844401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.844608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.844969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.845278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.845394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.845591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.845682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.845941 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.846088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.846298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.846448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.846641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.846813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.846919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.847131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.847240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.847490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.847591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.847809 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.847928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.848209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.848617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.848778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.848864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.848938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.849041 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.849153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.849377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.849756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.849892 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.849986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.850314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.850694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.851041 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.851590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.851989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.852293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.852639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.853164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.853530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.853788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.853993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.854206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.854616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.854859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.855392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.855695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.856011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.856329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.856688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.857002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.857374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.857692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.858029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.858205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.858359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.858537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.858894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.859063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.859216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.859368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.859529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.859691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.860004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.860158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.860322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.860474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.860626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.861534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.861796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.862843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.863354 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.863613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.863800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.864053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.864220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.864374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.864525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.864695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.864952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.865117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.865318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.865486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.865646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.865801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.866021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.866175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.866326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.866483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.867555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.867731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.867902 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.868065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.868065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.868354 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.868506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.868656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.869057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.870974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.871126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.871277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.871436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.871599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.871759 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.871925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.872085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.872246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.872399 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.872560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.872723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.872883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.873050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.873424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.873622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.873870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.874063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.874320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.874498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.874653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.874820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.875103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.875263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.875263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.875560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.875713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.875875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.876035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.876194 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.876407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.876574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.876738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.876985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.877156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.877308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.877461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.877612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.877762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.877966 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.878628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.879468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.879619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.879778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.879939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.880092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.880242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.880393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.880552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.880710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.880875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.881039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.881197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.881348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.881498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.881670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.881857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.882957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.883119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.883290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.883645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.883844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.884078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.884078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.884474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.884634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.884787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.884953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.885134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.885371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.885535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.885700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.885891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886823 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.886975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.887126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.887276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.887433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.887598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.887775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.887929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.888087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.888245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.888397 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.888547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.888706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.888858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.889010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.889377 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.889544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.889705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.889904 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.890064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.890217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.890217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.890502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.890733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.890896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.891056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.891209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.891368 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.891530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.891696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.891856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.892560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.892560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.892858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.893009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.893171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.893323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.893480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.893480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.894029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.894360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.894706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.894915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.895078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.895242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.895412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.895798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.895966 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.895966 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.896357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.896511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.896674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.896916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.897071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.897290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.897451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.897714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.897908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.898070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.898319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.898475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.898713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.898884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.899039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.899190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.899567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.899729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.899943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.900118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.900291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.900445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.900604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.900755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.900905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.901258 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.901511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.901677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.901851 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.902112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.902290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.902549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.902709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.902896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.903063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.903222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.903385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.903536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.903906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.904067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.904220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.904464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.904881 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.905054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.905216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.905389 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.905549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.905710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.906024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.906193 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.906360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.906512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.906671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.906838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.907008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.907248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.907412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.907598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.907897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.908085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.908241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.908392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.908543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.908694 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.908846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.909008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.909160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.909312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.909686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.909901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.912461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.912671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.912840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.913003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.913160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.913344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.914523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.914523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.914867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.915120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.915282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.915435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.915604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.915765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.915936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.916090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.916273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.916513 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.916688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.916688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.916987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.917147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.917308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.917468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.917634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.917787 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.917987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.918157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.918319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.918319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.918319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.918776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.918929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.919080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.919239 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.919402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.919573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.919955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.920117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.920280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.920433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.920667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.920829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.920997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.921153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.921306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.921457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.921624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.921784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.922981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.923140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.923829 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.923995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.924156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.924543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.924773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.924930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.925211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.925386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.925559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.925768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.925956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.926111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.926263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.926453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.926710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.926878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.927972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.928133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.928301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.928453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.928613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.928766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.928919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.929069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.929230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.929389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.929553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.929725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.930100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.930273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.930441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.930441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.930737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.930737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.931048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.931209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.931370 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.931522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.931685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.931844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.932024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.932869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.933170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.933356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.933515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.933675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.933897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.933897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.934197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.934377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.934719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.934980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.935156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.935411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.935569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.935722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.935882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.936041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.936209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.936361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.936514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.936673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.936932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.937109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.940222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.940411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.940578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.940792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.940956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.941140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.941307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.941463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.941626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.941786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.941993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.942162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.942337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.942501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.942653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.942831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.942831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.943221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.943374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.943534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.943695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.943847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.944015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.944168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.944328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.944491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.944850 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.945096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.945272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.945452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.945702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.945891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.945891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.946206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.946373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.946533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.946687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.946846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.947111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.947270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.947270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.947766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.947979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.948134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.948296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.948296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.948748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.948953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.949154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.949309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.949476 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.949638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.949802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.950024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.950345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.950514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.950675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.950838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951010 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951810 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.951970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.952138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.952299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.952518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.952692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.952862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.953046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.953270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.953427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.953590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.953752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.953951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.954115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.954268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.955205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.955387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.955542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.955721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.955962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.956127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.956280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.956441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.956600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.956769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.956921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.957073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.957337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.957509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.957664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.957831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.958006 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.958180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.959452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.959626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.959804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.959961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.960137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.960461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.960638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.960812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.960966 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.961117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.961117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.961405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.961405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.961760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.961760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.962114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.962296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.962456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.962617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.962777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.962977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.963134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.963303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.963540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.963706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.963859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.964019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.964171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.964323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.964495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.964648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.964808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.965804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.966008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.966253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.966431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.966595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.966595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.966890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.967049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.967201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.967380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.967647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.967814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.967814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.968129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.968129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.968430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.968590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.968751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.968909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.969068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.969310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.969475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.969629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.970099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.970287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.970611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.970798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.970952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.971113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.971273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.971426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.971591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.971755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.971916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.972078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.972249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.972403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.972564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.972723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.972885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.973038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.973188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.973346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.973526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.973759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.973962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.974116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.974268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.974441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.974604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.974756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.974915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.975730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.975894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.976979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.977322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.977475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.977653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.977910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.978083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.978246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.978398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.978558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.978717 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.978877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.979037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.979205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.979375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.979536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.979687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.979839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.980001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.980153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.980311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.980466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.980792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.980962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.981129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.981290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.981443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.981617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.981769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.981995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.982165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.982320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.982471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.982623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.982773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.982939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.983098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.983259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.983411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.983581 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.983752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.983990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.984149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.984310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.984463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.984614 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.984763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.984923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.985075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.985226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.985386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.986337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.986553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.986553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.987066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.987235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.987388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.987637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.987806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.988069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.988245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.988499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.988659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.988810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.989143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.989322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.989475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.989728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.989945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.990102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.990262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.990428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.990594 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.991067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.991332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.991498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.991661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.991916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.992075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.992227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.992478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.992710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.992878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.993042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.993335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.993499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.993715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.993906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.994149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.994317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.994469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.994629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.994790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.995024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.995178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.995330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.995487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.995809 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.995988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.996141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.996447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.996616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.996800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.997044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.997212 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.997374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.997533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.997685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.997685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.998105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.998358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.998516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.998668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.998820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.998980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.999160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.999320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.999492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.999647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.999806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:27.999964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.000129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.000289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.000455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.000616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.000769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.000920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.001304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.001504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.001666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.001846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002329 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.002937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.003099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.003266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.003426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.003578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.003737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.003916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.004127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.004356 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.004513 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.004741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.004904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.005057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.005218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.005380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.005550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.005710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.006082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.006262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.006444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.006744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.007673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.007839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.008057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.008264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.008422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.008583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.008857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.009024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.009177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.009343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.009504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.009665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.009842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.010969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.011140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.011461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.011621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.011773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.011932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.012870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.013227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.013385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.013536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.013689 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.013859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.014035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.014188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.014361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.014584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.014751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.014903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.015699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.019913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.021710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.024056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.025952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 12:49:28.027465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 12:49:28.051781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO dbcounter [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Registered counter for database nova_api Jul 29 12:49:28.061237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO dbcounter [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Registered counter for database nova_api Jul 29 12:49:28.072905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.080984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writer thread running {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.082898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_db.sqlalchemy.engines [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.089470 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writer thread running {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.139381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.context [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),700a5828-9678-4497-a9ca-54189636954d(cell1) {{(pid=129323) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 12:49:28.143657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:49:28.145449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:49:28.146250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:49:28.146482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.context [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),700a5828-9678-4497-a9ca-54189636954d(cell1) {{(pid=129324) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 12:49:28.148278 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:49:28.150307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO dbcounter [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Registered counter for database nova_cell0 Jul 29 12:49:28.150643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:49:28.152205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:49:28.153098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:49:28.154621 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO dbcounter [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Registered counter for database nova_cell1 Jul 29 12:49:28.155028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:49:28.157283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO dbcounter [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Registered counter for database nova_cell0 Jul 29 12:49:28.163477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO dbcounter [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Registered counter for database nova_cell1 Jul 29 12:49:28.163689 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.164921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.169569 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_db.sqlalchemy.engines [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.170569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writer thread running {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.173190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writer thread running {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.175293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_db.sqlalchemy.engines [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.179276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writer thread running {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.318647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writer thread running {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.327330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO dbcounter [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Registered counter for database nova_cell0 Jul 29 12:49:28.328582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO dbcounter [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Registered counter for database nova_cell0 Jul 29 12:49:28.336213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.336780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_db.sqlalchemy.engines [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 12:49:28.340741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writer thread running {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.341377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writer thread running {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 12:49:28.657469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: WARNING keystonemiddleware.auth_token [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:49:28.661978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: WARNING keystonemiddleware.auth_token [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:49:28.665000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: WARNING keystonemiddleware.auth_token [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:49:28.669238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: WARNING keystonemiddleware.auth_token [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:49:29.011245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: WARNING keystonemiddleware.auth_token [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:49:29.017303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: WARNING keystonemiddleware.auth_token [None req-fa4f4501-5438-4116-91a9-df8a2af03a2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:49:29.022758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9220849c0 pid: 129323 (default app) Jul 29 12:49:29.032326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: WARNING keystonemiddleware.auth_token [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 12:49:29.039127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: WARNING keystonemiddleware.auth_token [None req-172b8ebb-65b3-44bf-8323-b03f4d60b6c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 12:49:29.044705 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9220849c0 pid: 129324 (default app) Jul 29 12:50:10.682437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.683264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.684209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.685408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.790157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=3 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.792348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=3 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.794403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=3 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:10.797533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=3 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:11.821624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-51eb7a67-302a-4333-bcc7-40d626ce52d4 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Action: 'create', calling method: .version_select at 0x7f74a3ffdee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-888518881", "metadata": {"Type": "work"}}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-51eb7a67-302a-4333-bcc7-40d626ce52d4 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Request method failure captured: Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 121 Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eCpOARKHPEODaQN8H5jyml8__zIHbp0S7z6FfHHkcEq5wjbZiShoaCl9V4GDCQWqhsBl1I4BaGcHzfXWP_UKm5-_Xt2Yn7qJOP-QFQ0C2skcnPTzuD8cHPVrK78oOp7M-3U1BllZiqzUDzgvrKaAiBhBpPLrCeSREjPLTXE0IHLlk Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:11.828892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_367b19dc4a364576b869cef1931f0356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/367b19dc4a364576b869cef1931f0356"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 8c36da943dc24f848dab5f628d7083a0 Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-888518881", "metadata": {"Type": "work"}}} Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:11.830502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-888518881', 'metadata': {'Type': 'work'}}}} Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise error Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:11.831387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 12:50:11.832958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 12:50:11.834394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 12:50:11.834394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:11.834394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-51eb7a67-302a-4333-bcc7-40d626ce52d4 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:11.835679 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-51eb7a67-302a-4333-bcc7-40d626ce52d4 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.172212 Jul 29 12:50:11.842480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Jul 29 12:50:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:50:12.066337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9f8045e7-3e9e-4c88-a45e-99b33c6de6c5 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Action: 'create', calling method: .version_select at 0x7f74a3ffdee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-672010710"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:12.150642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f3e5e465-b0e4-4467-8098-db8ac28c9033 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Action: 'create', calling method: .version_select at 0x7f74a3f96670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1642844728", "metadata": {"Type": "work"}}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:13.488704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9f8045e7-3e9e-4c88-a45e-99b33c6de6c5 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.711976 Jul 29 12:50:13.489503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 29 12:50:10 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2715 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 12:50:13.494563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-23736bcf-dcb4-4e7c-8b71-ed7983c4bb0a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Action: 'create', calling method: .version_select at 0x7f74a3e81d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-854278439", "metadata": {"Type": "work"}}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-23736bcf-dcb4-4e7c-8b71-ed7983c4bb0a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Request method failure captured: Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 119 Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eCpOARKHPEODaQN8H5jyml8__zIHbp0S7z6FfHHkcEq5wjbZiShoaCl9V4GDCQWqhsBl1I4BaGcHzfXWP_UKm5-_Xt2Yn7qJOP-QFQ0C2skcnPTzuD8cHPVrK78oOp7M-3U1BllZiqzUDzgvrKaAiBhBpPLrCeSREjPLTXE0IHLlk Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:50:13.510584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_367b19dc4a364576b869cef1931f0356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/367b19dc4a364576b869cef1931f0356"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 8c36da943dc24f848dab5f628d7083a0 Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-854278439", "metadata": {"Type": "work"}}} Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: Jul 29 12:50:13.512103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-854278439', 'metadata': {'Type': 'work'}}}} Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise error Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi '0' Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:13.513026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 12:50:13.514485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 12:50:13.516264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 12:50:13.516264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.520099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-23736bcf-dcb4-4e7c-8b71-ed7983c4bb0a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:13.521125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-23736bcf-dcb4-4e7c-8b71-ed7983c4bb0a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030538 Jul 29 12:50:13.527860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Jul 29 12:50:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:50:13.549506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-70a1f19f-d400-4a49-8fd4-ecb5a7f9dcda tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e3a790>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:13.591791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f3e5e465-b0e4-4467-8098-db8ac28c9033 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.746901 Jul 29 12:50:13.592994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 2/4] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Jul 29 12:50:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1750 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 12:50:13.599148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-60186f02-5c84-4231-9a75-f43022409b9a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Action: 'create', calling method: .version_select at 0x7f74a3e3f310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1619777083", "metadata": {"Type": "work"}}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-60186f02-5c84-4231-9a75-f43022409b9a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Request method failure captured: Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 119 Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eCpOARKHPEODaQN8H5jyml8__zIHbp0S7z6FfHHkcEq5wjbZiShoaCl9V4GDCQWqhsBl1I4BaGcHzfXWP_UKm5-_Xt2Yn7qJOP-QFQ0C2skcnPTzuD8cHPVrK78oOp7M-3U1BllZiqzUDzgvrKaAiBhBpPLrCeSREjPLTXE0IHLlk Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:13.605131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_367b19dc4a364576b869cef1931f0356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/367b19dc4a364576b869cef1931f0356"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 8c36da943dc24f848dab5f628d7083a0 Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1619777083", "metadata": {"Type": "work"}}} Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:13.606702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1619777083', 'metadata': {'Type': 'work'}}}} Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise error Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi '' Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:13.607926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 12:50:13.609930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 12:50:13.611203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 12:50:13.611203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.616433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-60186f02-5c84-4231-9a75-f43022409b9a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:13.617580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-60186f02-5c84-4231-9a75-f43022409b9a tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023189 Jul 29 12:50:13.619767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 3/5] 10.222.0.66 () {60 vars in 1156 bytes} [Fri Jul 29 12:50:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:50:13.632125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-34b31224-6d1f-44c6-8763-ca708ba0ec0b tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a48051f0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:13.677848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-70a1f19f-d400-4a49-8fd4-ecb5a7f9dcda tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 200 len: 344 microversion: 2.1 time: 0.148569 Jul 29 12:50:13.678923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:13 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:13.684100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ac694d68-2931-4818-94c4-3c0581a6a4f0 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Calling method '.version_select at 0x7f74a3e91820>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:13.793075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-34b31224-6d1f-44c6-8763-ca708ba0ec0b tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 200 len: 353 microversion: 2.1 time: 0.166437 Jul 29 12:50:13.793628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:13 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:13.847939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-ac694d68-2931-4818-94c4-3c0581a6a4f0 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] HTTP exception thrown: Volume tempest-invalid-40216473 could not be found. Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ac694d68-2931-4818-94c4-3c0581a6a4f0 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Request method failure captured: Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-40216473 HTTP/1.1 Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eCpOARKHPEODaQN8H5jyml8__zIHbp0S7z6FfHHkcEq5wjbZiShoaCl9V4GDCQWqhsBl1I4BaGcHzfXWP_UKm5-_Xt2Yn7qJOP-QFQ0C2skcnPTzuD8cHPVrK78oOp7M-3U1BllZiqzUDzgvrKaAiBhBpPLrCeSREjPLTXE0IHLlk Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:50:13.852202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_367b19dc4a364576b869cef1931f0356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/367b19dc4a364576b869cef1931f0356"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 8c36da943dc24f848dab5f628d7083a0 Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Volume tempest-invalid-40216473 could not be found. Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': 'tempest-invalid-40216473'} Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:13.853700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-40216473 could not be found. (HTTP 404) (Request-ID: req-0be0bba2-e51b-4e4b-8500-d1111a853ab1) Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.855063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 12:50:13.856485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-40216473 could not be found. Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:13.857982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-40216473 could not be found. Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-40216473 could not be found. Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ac694d68-2931-4818-94c4-3c0581a6a4f0 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Returning 404 to user: Volume tempest-invalid-40216473 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ac694d68-2931-4818-94c4-3c0581a6a4f0 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-40216473" status: 404 len: 97 microversion: 2.1 time: 0.173469 Jul 29 12:50:13.859435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1212 bytes} [Fri Jul 29 12:50:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-40216473 => generated 97 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 29 12:50:13.866979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-22c585d7-1943-415c-b2a8-8b6b49c32684 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004925 Jul 29 12:50:13.867992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 5/9] 10.222.0.66 () {58 vars in 1140 bytes} [Fri Jul 29 12:50:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 12:50:13.886923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2d0002f5-b455-4006-8b1a-a6b102af6f04 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013826 Jul 29 12:50:13.892666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1137 bytes} [Fri Jul 29 12:50:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 12:50:13.898964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-419b0d8b-302c-4357-ab95-0ba3fce5219b tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Calling method '.version_select at 0x7f74a3e3f550>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:13.955591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-419b0d8b-302c-4357-ab95-0ba3fce5219b tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] HTTP exception thrown: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-419b0d8b-302c-4357-ab95-0ba3fce5219b tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Request method failure captured: Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/os-volumes/bc058190-655d-4bc0-b705-649ceaedeac4 HTTP/1.1 Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eCpOARKHPEODaQN8H5jyml8__zIHbp0S7z6FfHHkcEq5wjbZiShoaCl9V4GDCQWqhsBl1I4BaGcHzfXWP_UKm5-_Xt2Yn7qJOP-QFQ0C2skcnPTzuD8cHPVrK78oOp7M-3U1BllZiqzUDzgvrKaAiBhBpPLrCeSREjPLTXE0IHLlk Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:13.959732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_367b19dc4a364576b869cef1931f0356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/367b19dc4a364576b869cef1931f0356"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 8c36da943dc24f848dab5f628d7083a0 Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'bc058190-655d-4bc0-b705-649ceaedeac4'} Jul 29 12:50:13.961148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. (HTTP 404) (Request-ID: req-046928d3-2d54-4bce-ac3e-44a300188e7a) Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.966058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 12:50:13.967221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 12:50:13.968295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-419b0d8b-302c-4357-ab95-0ba3fce5219b tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Returning 404 to user: Volume bc058190-655d-4bc0-b705-649ceaedeac4 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-419b0d8b-302c-4357-ab95-0ba3fce5219b tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/bc058190-655d-4bc0-b705-649ceaedeac4" status: 404 len: 109 microversion: 2.1 time: 0.067103 Jul 29 12:50:13.970190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:50:13 2022] DELETE /compute/v2.1/os-volumes/bc058190-655d-4bc0-b705-649ceaedeac4 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:50:13.971664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b299e13c-97fb-4cda-a401-b8d7652bb2a9 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Calling method '.version_select at 0x7f74a3e91790>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:14.048448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-b299e13c-97fb-4cda-a401-b8d7652bb2a9 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] HTTP exception thrown: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b299e13c-97fb-4cda-a401-b8d7652bb2a9 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Request method failure captured: Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/os-volumes/b0575aa7-08ee-48b1-8e75-4f35b95d620a HTTP/1.1 Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eCpOARKHPEODaQN8H5jyml8__zIHbp0S7z6FfHHkcEq5wjbZiShoaCl9V4GDCQWqhsBl1I4BaGcHzfXWP_UKm5-_Xt2Yn7qJOP-QFQ0C2skcnPTzuD8cHPVrK78oOp7M-3U1BllZiqzUDzgvrKaAiBhBpPLrCeSREjPLTXE0IHLlk Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:50:14.050441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_367b19dc4a364576b869cef1931f0356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/367b19dc4a364576b869cef1931f0356"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/367b19dc4a364576b869cef1931f0356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 367b19dc4a364576b869cef1931f0356 Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-VolumesNegativeTest-350860441 Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 8c36da943dc24f848dab5f628d7083a0 Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-VolumesNegativeTest-350860441-project Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': 'b0575aa7-08ee-48b1-8e75-4f35b95d620a'} Jul 29 12:50:14.051753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. (HTTP 404) (Request-ID: req-63811e15-e5c8-4ebd-b1f5-7a49a1b3b346) Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:14.052534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:14.053618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 12:50:14.054739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b299e13c-97fb-4cda-a401-b8d7652bb2a9 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] Returning 404 to user: Volume b0575aa7-08ee-48b1-8e75-4f35b95d620a could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b299e13c-97fb-4cda-a401-b8d7652bb2a9 tempest-VolumesNegativeTest-350860441 tempest-VolumesNegativeTest-350860441-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b0575aa7-08ee-48b1-8e75-4f35b95d620a" status: 404 len: 109 microversion: 2.1 time: 0.084805 Jul 29 12:50:14.055917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:13 2022] GET /compute/v2.1/os-volumes/b0575aa7-08ee-48b1-8e75-4f35b95d620a => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:50:14.695087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-78b3332b-8f61-426e-8cb7-460886108d59 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e3faf0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:14.764875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-78b3332b-8f61-426e-8cb7-460886108d59 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 200 len: 345 microversion: 2.1 time: 0.074965 Jul 29 12:50:14.765495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:14 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:14.778413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6f07b711-0064-4631-9464-b2fc3366703b tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Action: 'create', calling method: .version_select at 0x7f74a3e91af0>, body: {"snapshot": {"volume_id": "5b017eee-cae1-4031-95b0-a60bda11700c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2040851524"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:14.808409 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2e6b60a3-e84a-4110-952c-b4baf85c9ea3 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3e3fc10>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:15.084403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2e6b60a3-e84a-4110-952c-b4baf85c9ea3 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 200 len: 354 microversion: 2.1 time: 0.280609 Jul 29 12:50:15.085265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 8/14] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:14 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:15.101951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e3d321aa-069b-4554-a696-32fd58b30f00 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3f96b80>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:15.175548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e3d321aa-069b-4554-a696-32fd58b30f00 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 200 len: 354 microversion: 2.1 time: 0.079701 Jul 29 12:50:15.176432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 9/15] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:15 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:15.210671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f4b0d66a-9d57-4c99-b026-303bd9340e05 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3e118b0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:15.218135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6f07b711-0064-4631-9464-b2fc3366703b tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.443276 Jul 29 12:50:15.222360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 7/16] 10.222.0.66 () {60 vars in 1162 bytes} [Fri Jul 29 12:50:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:15.231888 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-13549f7f-d0e3-4598-a15d-d95b1f1d2dab tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a48070d0>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:15.304648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-13549f7f-d0e3-4598-a15d-d95b1f1d2dab tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 200 len: 287 microversion: 2.1 time: 0.077770 Jul 29 12:50:15.305677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 8/17] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:15 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:15.322161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0b2ef79e-ef80-4efa-91f8-65a196238fb2 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e91700>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:15.544464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f4b0d66a-9d57-4c99-b026-303bd9340e05 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 202 len: 0 microversion: 2.1 time: 0.348658 Jul 29 12:50:15.545494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 10/18] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:50:15 2022] DELETE /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:50:15.557581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ef0ee5aa-0bfa-42f1-8df2-dda227dfd6b1 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3e3f1f0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:15.924552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0b2ef79e-ef80-4efa-91f8-65a196238fb2 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.606277 Jul 29 12:50:15.925642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 9/19] 10.222.0.66 () {58 vars in 1140 bytes} [Fri Jul 29 12:50:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:15.938890 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-01341a27-5b7e-433b-9775-9d77eb434c2e tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e1cd30>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:16.057681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ef0ee5aa-0bfa-42f1-8df2-dda227dfd6b1 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 200 len: 353 microversion: 2.1 time: 0.507907 Jul 29 12:50:16.058283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 11/20] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:15 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 353 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:16.171060 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-01341a27-5b7e-433b-9775-9d77eb434c2e tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 200 len: 287 microversion: 2.1 time: 0.237917 Jul 29 12:50:16.172485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 10/21] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:15 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 287 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:17.073245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d9c09156-bc56-4acf-aaac-e82ca9c0d6c4 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3e3f670>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:17.186952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-852c6083-b968-4be5-bb1c-ee2139cfecea tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e1c940>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:17.219856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d9c09156-bc56-4acf-aaac-e82ca9c0d6c4 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 200 len: 353 microversion: 2.1 time: 0.151935 Jul 29 12:50:17.225102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 12/22] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:17 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:17.255360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-852c6083-b968-4be5-bb1c-ee2139cfecea tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 200 len: 287 microversion: 2.1 time: 0.072505 Jul 29 12:50:17.256252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:17 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:18.234707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2eb3cfbd-89d9-4c92-b51d-020f83a0fbfc tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3e4e0d0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:18.268883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3a9f404f-0b92-4835-87ee-6b98be28d469 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e1c3a0>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:18.353603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3a9f404f-0b92-4835-87ee-6b98be28d469 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 200 len: 287 microversion: 2.1 time: 0.089272 Jul 29 12:50:18.354409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 12/24] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:18 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:18.364600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2eb3cfbd-89d9-4c92-b51d-020f83a0fbfc tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 200 len: 353 microversion: 2.1 time: 0.134281 Jul 29 12:50:18.368304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:18 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:19.367341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f1cb2c55-9201-46b3-bf58-186355ffad74 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e91550>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:19.387676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9b6f5442-7db0-439b-a038-6fdaac50ec02 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Calling method '.version_select at 0x7f74a3e11940>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:19.445036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f1cb2c55-9201-46b3-bf58-186355ffad74 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 200 len: 288 microversion: 2.1 time: 0.081940 Jul 29 12:50:19.445602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 13/26] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:19 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:19.457245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ebb2adfa-dd4c-4f44-bd69-dc0977bb5c09 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a48070d0>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:19.494462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-9b6f5442-7db0-439b-a038-6fdaac50ec02 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] HTTP exception thrown: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9b6f5442-7db0-439b-a038-6fdaac50ec02 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Request method failure captured: Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b HTTP/1.1 Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eCqsd1l-bP-eZ24whV4CJ5AP7dnsUx2OBXHmUtErW1c0u1MLifrIe8OHuBp4pgjMQHopmtHdtgGS3VypAMGyC91DbrsLgAdeEDarFR_iBNMQ4UKG1Lp2kNtvWq1C9iSOqkMvuSxRkUeFLQljp2Be4c1_UNT4Iyg0ZGPnJx332xJBI Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 3be5d64be552499d888f5d6bc6ad8414 Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesGetTestJSON-1541159551 Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:19.498061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3be5d64be552499d888f5d6bc6ad8414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3be5d64be552499d888f5d6bc6ad8414"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3be5d64be552499d888f5d6bc6ad8414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3be5d64be552499d888f5d6bc6ad8414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesGetTestJSON-1541159551 Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 3be5d64be552499d888f5d6bc6ad8414 Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesGetTestJSON-1541159551 Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesGetTestJSON-1541159551-project Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 52feac75e3484fe09e2b2af895640995 Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesGetTestJSON-1541159551-project Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '56c0ce15-3600-4002-8df2-76da8610dc4b'} Jul 29 12:50:19.499630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. (HTTP 404) (Request-ID: req-4aa203f0-6f1e-42fe-87ac-454539c849e5) Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:19.500464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:19.501556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 12:50:19.502701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. Jul 29 12:50:19.503879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:19.505935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9b6f5442-7db0-439b-a038-6fdaac50ec02 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] Returning 404 to user: Volume 56c0ce15-3600-4002-8df2-76da8610dc4b could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:19.506946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9b6f5442-7db0-439b-a038-6fdaac50ec02 tempest-VolumesGetTestJSON-1541159551 tempest-VolumesGetTestJSON-1541159551-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b" status: 404 len: 109 microversion: 2.1 time: 0.127441 Jul 29 12:50:19.507641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 14/27] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:19 2022] GET /compute/v2.1/os-volumes/56c0ce15-3600-4002-8df2-76da8610dc4b => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 12:50:19.732887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ebb2adfa-dd4c-4f44-bd69-dc0977bb5c09 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 202 len: 0 microversion: 2.1 time: 0.280101 Jul 29 12:50:19.733904 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 14/28] 10.222.0.66 () {58 vars in 1254 bytes} [Fri Jul 29 12:50:19 2022] DELETE /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 12:50:19.742310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a791dbb8-7d43-45e8-a6e1-86902fcf6edd tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e3f550>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:19.897798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a791dbb8-7d43-45e8-a6e1-86902fcf6edd tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 200 len: 287 microversion: 2.1 time: 0.159495 Jul 29 12:50:19.899170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 15/29] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:19 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 287 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:20.912424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e65dd156-3493-4c7a-83b5-19f8f7dd4ae3 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e91700>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:20.970347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-e65dd156-3493-4c7a-83b5-19f8f7dd4ae3 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] HTTP exception thrown: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e65dd156-3493-4c7a-83b5-19f8f7dd4ae3 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Request method failure captured: Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 HTTP/1.1 Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eC_UmaryvK4VoiLqoWFThZTeHTA0lXKHf--J6taYpgCeU-eF4w5QLvc7cOa1Tju_ClGNBxIgIyjYOO-HqpFtI7490W65K8sI4u0Q_zuMakIqz-b3oYfO542MF4R2eyK_1lhcVIIV9622s2EbYfiVXvgUc6hAHwvAv7R-8NW5e2qAo Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:50:20.971838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 5b65afab1e5e44cbbb53fc99a4590178 Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '720dc3c2-6cc0-4d61-ad42-da5cee13dc21'} Jul 29 12:50:20.973267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. (HTTP 404) (Request-ID: req-65650066-adf4-451a-b0c7-d4473873be67) Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.974231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:20.975342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 12:50:20.976411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. Jul 29 12:50:20.977509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:50:20.989760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e65dd156-3493-4c7a-83b5-19f8f7dd4ae3 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Returning 404 to user: Snapshot 720dc3c2-6cc0-4d61-ad42-da5cee13dc21 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:20.991128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e65dd156-3493-4c7a-83b5-19f8f7dd4ae3 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21" status: 404 len: 111 microversion: 2.1 time: 0.083662 Jul 29 12:50:20.992183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 15/30] 10.222.0.66 () {58 vars in 1251 bytes} [Fri Jul 29 12:50:20 2022] GET /compute/v2.1/os-snapshots/720dc3c2-6cc0-4d61-ad42-da5cee13dc21 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:50:21.001295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a1d1873c-999d-41ec-bd2e-f3d6c7bf5db8 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e3f1f0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:21.121402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a1d1873c-999d-41ec-bd2e-f3d6c7bf5db8 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 202 len: 0 microversion: 2.1 time: 0.123965 Jul 29 12:50:21.125309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 16/31] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:50:20 2022] DELETE /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:50:21.131056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0eaeef6f-8eb5-4021-9717-393d1e18d2b0 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e1c670>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:21.235732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0eaeef6f-8eb5-4021-9717-393d1e18d2b0 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 200 len: 344 microversion: 2.1 time: 0.107374 Jul 29 12:50:21.236936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 16/32] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:21 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:22.256785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9651c632-2d55-4d49-b559-4ec3591b8cd5 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e3fc10>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:22.391081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9651c632-2d55-4d49-b559-4ec3591b8cd5 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 200 len: 344 microversion: 2.1 time: 0.143131 Jul 29 12:50:22.392513 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 17/33] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:22 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 344 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:22.605924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-384014864", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "networks": [{"uuid": "7b4d35ff-51cb-4388-9ca0-176c187a7f0d"}]}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:22.915322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.network.neutron [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] validate_networks() for [('7b4d35ff-51cb-4388-9ca0-176c187a7f0d', None, None, None, None, None)] {{(pid=129324) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:50:23.412545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-782201c4-abde-4fc4-98f8-f722120ab8f0 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a48053a0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:23.589463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-782201c4-abde-4fc4-98f8-f722120ab8f0 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 200 len: 344 microversion: 2.1 time: 0.188071 Jul 29 12:50:23.590447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 18/34] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:23 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:24.606244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-39bf5104-5ce7-4bbe-852a-0940f4ff4129 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e4e310>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:24.729603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-39bf5104-5ce7-4bbe-852a-0940f4ff4129 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] HTTP exception thrown: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-39bf5104-5ce7-4bbe-852a-0940f4ff4129 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Request method failure captured: Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c HTTP/1.1 Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eC_UmaryvK4VoiLqoWFThZTeHTA0lXKHf--J6taYpgCeU-eF4w5QLvc7cOa1Tju_ClGNBxIgIyjYOO-HqpFtI7490W65K8sI4u0Q_zuMakIqz-b3oYfO542MF4R2eyK_1lhcVIIV9622s2EbYfiVXvgUc6hAHwvAv7R-8NW5e2qAo Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:24.732482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 5b65afab1e5e44cbbb53fc99a4590178 Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '5b017eee-cae1-4031-95b0-a60bda11700c'} Jul 29 12:50:24.733638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. (HTTP 404) (Request-ID: req-52528472-09bc-43ce-a6c2-52e5c53a39d2) Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.734822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:24.735799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 12:50:24.736778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.737882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.739264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-39bf5104-5ce7-4bbe-852a-0940f4ff4129 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Returning 404 to user: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:24.740448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-39bf5104-5ce7-4bbe-852a-0940f4ff4129 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 404 len: 109 microversion: 2.1 time: 0.139589 Jul 29 12:50:24.741586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 19/35] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:24 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:50:24.759979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ddce7838-7a44-4a95-8b60-315b42136e46 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a4805280>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:24.864359 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-ddce7838-7a44-4a95-8b60-315b42136e46 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] HTTP exception thrown: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ddce7838-7a44-4a95-8b60-315b42136e46 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Request method failure captured: Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c HTTP/1.1 Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eC_UmaryvK4VoiLqoWFThZTeHTA0lXKHf--J6taYpgCeU-eF4w5QLvc7cOa1Tju_ClGNBxIgIyjYOO-HqpFtI7490W65K8sI4u0Q_zuMakIqz-b3oYfO542MF4R2eyK_1lhcVIIV9622s2EbYfiVXvgUc6hAHwvAv7R-8NW5e2qAo Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:24.867089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 5b65afab1e5e44cbbb53fc99a4590178 Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '5b017eee-cae1-4031-95b0-a60bda11700c'} Jul 29 12:50:24.868116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. (HTTP 404) (Request-ID: req-00cd2780-fa5e-4920-bede-0d0a4f4502eb) Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.868787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 12:50:24.869778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 12:50:24.870708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.871705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.877313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ddce7838-7a44-4a95-8b60-315b42136e46 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Returning 404 to user: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:24.878435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ddce7838-7a44-4a95-8b60-315b42136e46 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 404 len: 109 microversion: 2.1 time: 0.126563 Jul 29 12:50:24.879200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 20/36] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:50:24 2022] DELETE /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 12:50:24.889800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-559f242a-8d5a-44b4-af02-40ebe1ffe895 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Calling method '.version_select at 0x7f74a3e3f790>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:24.940272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-559f242a-8d5a-44b4-af02-40ebe1ffe895 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] HTTP exception thrown: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-559f242a-8d5a-44b4-af02-40ebe1ffe895 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Request method failure captured: Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c HTTP/1.1 Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eC_UmaryvK4VoiLqoWFThZTeHTA0lXKHf--J6taYpgCeU-eF4w5QLvc7cOa1Tju_ClGNBxIgIyjYOO-HqpFtI7490W65K8sI4u0Q_zuMakIqz-b3oYfO542MF4R2eyK_1lhcVIIV9622s2EbYfiVXvgUc6hAHwvAv7R-8NW5e2qAo Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:50:24.944418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc5920aa5d9c4b8393148fc8ae6db786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: dc5920aa5d9c4b8393148fc8ae6db786 Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-296612125 Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 5b65afab1e5e44cbbb53fc99a4590178 Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesSnapshotsTestJSON-296612125-project Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '5b017eee-cae1-4031-95b0-a60bda11700c'} Jul 29 12:50:24.945701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. (HTTP 404) (Request-ID: req-f772365c-e650-4246-a62a-d10f47915ac8) Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.946448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 12:50:24.947461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 12:50:24.948422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-559f242a-8d5a-44b4-af02-40ebe1ffe895 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] Returning 404 to user: Volume 5b017eee-cae1-4031-95b0-a60bda11700c could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:50:24.949394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-559f242a-8d5a-44b4-af02-40ebe1ffe895 tempest-VolumesSnapshotsTestJSON-296612125 tempest-VolumesSnapshotsTestJSON-296612125-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c" status: 404 len: 109 microversion: 2.1 time: 0.062822 Jul 29 12:50:24.951819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 21/37] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:50:24 2022] GET /compute/v2.1/os-volumes/5b017eee-cae1-4031-95b0-a60bda11700c => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:50:27.057533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-341382946", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:27.393843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] validate_networks() for [('3dd8fb12-1c94-4bff-a156-ebe21acefc2b', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:50:27.851587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Flavor limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:50:27.852103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Image limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:50:27.852554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Flavor pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:50:27.853127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Image pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:50:27.853733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:50:27.897279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:27.897708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:27.899135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:27.899932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:27.947388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Getting quotas for project f9210aacd9bd4593a85429fe1768e28d. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:27.959576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Getting quotas for user b3a4fdcc0dde49009f4e55d25af4da7c and project f9210aacd9bd4593a85429fe1768e28d. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:27.979050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Going to run 1 instances... {{(pid=129324) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:50:27.982835 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129324) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:50:28.126050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1f77fee1-b099-456f-aaad-2b2301ed2800 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.754727 Jul 29 12:50:28.126816 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 17/38] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 5773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 12:50:28.879647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-da471edc-3359-4d1c-baed-ce34382f0359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: .version_select at 0x7f74a2cb5040>, body: {"keypair": {"name": "tempest-keypair-1491929470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP7/MqNQVZE6UpOmxqppd1vqUR9HnAeKBVsNEuX4jVBYDiubLfZ3cQxu9wOak1uIQCsVizyY9A6wFGQf8rX403JWHpXtgnmkSrR+i0EvydyGquOfvqUG0t6Xl2eNWxQ+Q=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:28.945342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-da471edc-3359-4d1c-baed-ce34382f0359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:28.960479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-da471edc-3359-4d1c-baed-ce34382f0359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:29.068464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-da471edc-3359-4d1c-baed-ce34382f0359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.938481 Jul 29 12:50:29.069084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 18/39] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:50:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:29.794191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f89b09ed-1768-40e3-ab4c-290e56e5dcad tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'create', calling method: .version_select at 0x7f74a2cb89d0>, body: {"keypair": {"name": "tempest-keypair-281023360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhlTyPYBs6E/FnjL3SpkNbn/aPM8fZdXoiPSmPhJrfg7xV1PdmePESIk3k5OoUTjajYWQYJtdWjtx2zvbESH9sSL5XQAJUSrZAVpFR5IIvc5Sd11YUmy7YSiTwSHLw3Sg=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:29.830779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-f89b09ed-1768-40e3-ab4c-290e56e5dcad tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:29.849675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-f89b09ed-1768-40e3-ab4c-290e56e5dcad tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for user e7ee2c3480f8483bb76ecc686215720b and project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:29.913998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f89b09ed-1768-40e3-ab4c-290e56e5dcad tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.843837 Jul 29 12:50:29.914617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 19/40] 10.222.0.66 () {62 vars in 1200 bytes} [Fri Jul 29 12:50:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 845 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 12:50:29.919768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-725d6cf9-f6a1-4618-bac0-fc5aca43cd80 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:29.920552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-725d6cf9-f6a1-4618-bac0-fc5aca43cd80 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:30.539371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-725d6cf9-f6a1-4618-bac0-fc5aca43cd80 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:30.579457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-725d6cf9-f6a1-4618-bac0-fc5aca43cd80 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1214 microversion: 2.1 time: 0.663718 Jul 29 12:50:30.603271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 20/41] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:29 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1214 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:30.855387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:50:30.855850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:50:30.856447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:50:30.856863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:50:30.857286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:50:30.906478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:30.906858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:30.912906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:30.916783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:31.045417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:31.075948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for user 1dd24e8c0d214a0bb62578f9834a40a2 and project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:31.168366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:50:31.184756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:50:31.468061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-450d1c8d-130b-4a9d-b443-e1fe31aa706e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.927881 Jul 29 12:50:31.484631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0c589d83-82c9-45f5-846f-a1d2c230f010 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:31.485393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0c589d83-82c9-45f5-846f-a1d2c230f010 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:31.496858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:50:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:50:31.607389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-998e31f5-340d-4808-9af9-dda8a6c1a3fd tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:31.608073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-998e31f5-340d-4808-9af9-dda8a6c1a3fd tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:31.728508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0c589d83-82c9-45f5-846f-a1d2c230f010 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:31.738500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0c589d83-82c9-45f5-846f-a1d2c230f010 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1221 microversion: 2.1 time: 0.258620 Jul 29 12:50:31.750794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 21/43] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:31 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:32.064080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-220776117", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:32.231782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.network.neutron [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] validate_networks() for [('3dd8fb12-1c94-4bff-a156-ebe21acefc2b', None, None, None, None, None)] {{(pid=129324) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:50:32.247364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-998e31f5-340d-4808-9af9-dda8a6c1a3fd tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:32.297158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-998e31f5-340d-4808-9af9-dda8a6c1a3fd tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1214 microversion: 2.1 time: 0.693333 Jul 29 12:50:32.301808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 23/44] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:31 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1214 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:33.331741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:33.334940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:33.364971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:33.367475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:33.369218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:33.376496 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:34.076248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:34.117309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5cfd7726-981a-473e-8643-6677710457bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1274 microversion: 2.1 time: 0.798032 Jul 29 12:50:34.146782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 24/45] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:33 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1274 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:35.025273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-74654212", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3"}], "security_groups": [{"name": "tempest-securitygroup--1906490799"}], "key_name": "tempest-keypair-1491929470", "user_data": "}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:36.051640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] validate_networks() for [('2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:50:36.398675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Flavor limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:50:36.399192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Image limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:50:36.399525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Flavor pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:50:36.400000 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Image pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:50:36.400605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:50:36.450046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:36.452043 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:36.453032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:36.453489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:36.547181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:36.574014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for user 1dd24e8c0d214a0bb62578f9834a40a2 and project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:36.640069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Going to run 1 instances... {{(pid=129324) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:50:36.660482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129324) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:50:36.795636 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-64dbc336-f1a9-4ff9-a0af-d77fe1dae825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.736731 Jul 29 12:50:36.815742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 22/46] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:50:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 4757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 12:50:36.837029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:36.842951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:36.867030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:36.871822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:36.872914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:36.873579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:37.859970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:37.889515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-80d17a5f-2e13-43c8-a88a-807d53f33023 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 1.069267 Jul 29 12:50:37.912857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 23/47] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:36 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:37.924108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c0ac255f-974a-438a-9bc4-2f729346b0dd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:37.925974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c0ac255f-974a-438a-9bc4-2f729346b0dd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:38.060283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c0ac255f-974a-438a-9bc4-2f729346b0dd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:38.068576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c0ac255f-974a-438a-9bc4-2f729346b0dd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1221 microversion: 2.1 time: 0.154345 Jul 29 12:50:38.069539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:37 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:38.087753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-585836045", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea4321cb-e5ed-4859-84aa-a7f6d2ae9505"}], "security_groups": [{"name": "tempest-securitygroup--448483582"}], "key_name": "tempest-keypair-281023360", "user_data": "}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:38.590395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.network.neutron [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] validate_networks() for [('ea4321cb-e5ed-4859-84aa-a7f6d2ae9505', None, None, None, None, None)] {{(pid=129324) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:50:40.004305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Flavor limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:50:40.004947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Image limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:50:40.005480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Flavor pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:50:40.006025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Image pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:50:40.006447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:50:40.019322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:40.019781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:40.020741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:40.021034 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:40.063765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:40.071103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for user e7ee2c3480f8483bb76ecc686215720b and project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:40.096363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Going to run 1 instances... {{(pid=129324) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:50:40.099854 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129324) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:50:40.151481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-761d624b-1669-4ea5-bc91-c0ed99fc19af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.078358 Jul 29 12:50:40.152920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 25/49] 10.222.0.66 () {62 vars in 1188 bytes} [Fri Jul 29 12:50:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 12:50:40.158408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:40.159612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:40.166817 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:40.167497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:40.168518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:40.169036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:40.491927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:40.521354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3bad80b4-7d56-4b33-b61b-460485bf71b6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.367136 Jul 29 12:50:40.522502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 26/50] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:40 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:40.529695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:40.530780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:40.540483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:40.541012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:40.541900 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:40.542475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:40.783403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:40.804704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b850aa1-5fda-4ef2-a32a-d3d98d5927fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1281 microversion: 2.1 time: 0.280537 Jul 29 12:50:40.805299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 27/51] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:40 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:40.841734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e7aa524d-6807-4d52-bfd0-b953f980300c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:40.842383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e7aa524d-6807-4d52-bfd0-b953f980300c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:40.963548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:41.020877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:50:41.021311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:50:41.021798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:50:41.022338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:50:41.022656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:50:41.049415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:41.049948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:41.050797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:41.051259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:41.052354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e7aa524d-6807-4d52-bfd0-b953f980300c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:41.062790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e7aa524d-6807-4d52-bfd0-b953f980300c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:41.065597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e7aa524d-6807-4d52-bfd0-b953f980300c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:41.068717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e7aa524d-6807-4d52-bfd0-b953f980300c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1280 microversion: 2.20 time: 0.251699 Jul 29 12:50:41.075174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 28/52] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:40 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:41.134173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:50:41.151378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:50:41.195202 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:50:41.198072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:50:41.319602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6bc354ea-1562-47bc-8fdf-9f317f610395 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.295075 Jul 29 12:50:41.329135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 25/53] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:50:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 6309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:50:41.332020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f1bef201-405d-4711-bae9-7db1f0473a6f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:41.332635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f1bef201-405d-4711-bae9-7db1f0473a6f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:41.343794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:41.417692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f1bef201-405d-4711-bae9-7db1f0473a6f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:41.434602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f1bef201-405d-4711-bae9-7db1f0473a6f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1240 microversion: 2.1 time: 0.106264 Jul 29 12:50:41.435559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 29/54] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:41 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:41.544459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:41.545195 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:41.570963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:41.575221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:41.578085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:41.580065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:41.850744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:41.861418 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:41.907323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:41.912608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:41.915407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:41.916033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:42.044667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:42.054876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1f461ef5-01d2-488f-bb2e-3c989bb7bf65 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1279 microversion: 2.1 time: 0.225069 Jul 29 12:50:42.059065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 30/55] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:41 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:42.101885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:42.102798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:42.116351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:42.117314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:42.118862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:42.119610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:42.281458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:42.298749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:42.300413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:42.301582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-990372e9-9d3f-446a-a3e6-c614e8d6ae50 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.204691 Jul 29 12:50:42.306168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 31/56] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:42 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:42.458473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:42.459213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:42.473717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:42.475169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:42.478066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:42.482569 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:42.502514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:42.513039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6b7bcc61-5574-4091-87bc-f956d994a226 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.972324 Jul 29 12:50:42.516583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 26/57] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:41 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:42.663203 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:42.680452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-289bc1cf-8bcb-47ee-83ee-08b9820439db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.223608 Jul 29 12:50:42.683543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 32/58] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:42 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:43.076814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:43.078114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:43.085392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.086188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.093468 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.094175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.182761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:43.195286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b856dec7-6044-4a90-9872-72874beaecd1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1279 microversion: 2.1 time: 0.123004 Jul 29 12:50:43.196150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 27/59] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:43 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:43.324795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:43.325505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:43.334381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.334843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.335635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.336086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.433624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:43.443057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:43.444598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:43.445696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b9633f2c-6e3a-4114-8e1b-19e2b073ec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.124994 Jul 29 12:50:43.446301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 28/60] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:43 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:43.489547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-e3e3e55c-6fba-412d-9559-a3d6ef7ef8a5 req-d27779fb-fe62-4a53-a971-0ce79d797da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ede090-2e12-43db-9393-9cb26deda854", "tag": "c4e2b023-7879-4e11-a3a4-d61a5cf343b4"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:43.507654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-e3e3e55c-6fba-412d-9559-a3d6ef7ef8a5 req-d27779fb-fe62-4a53-a971-0ce79d797da9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.508260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-e3e3e55c-6fba-412d-9559-a3d6ef7ef8a5 req-d27779fb-fe62-4a53-a971-0ce79d797da9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.532585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-e3e3e55c-6fba-412d-9559-a3d6ef7ef8a5 req-d27779fb-fe62-4a53-a971-0ce79d797da9 service nova] Creating event network-changed:c4e2b023-7879-4e11-a3a4-d61a5cf343b4 for instance 84ede090-2e12-43db-9393-9cb26deda854 on hv-cinder-81914 Jul 29 12:50:43.533233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-e3e3e55c-6fba-412d-9559-a3d6ef7ef8a5 req-d27779fb-fe62-4a53-a971-0ce79d797da9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129324) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 12:50:43.534938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.535383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.536232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.538505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.543001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:43.544569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:43.552650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.553396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.554675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.555313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.555547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.compute.rpcapi [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 12:50:43.556441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] Releasing lock "compute-rpcapi-router" {{(pid=129324) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 12:50:43.580228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-159ad436-6f1d-4325-9449-53fe80097fa0 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353139 Jul 29 12:50:43.580850 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 33/61] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:43.709444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:43.710506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:43.715020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:43.718967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.719429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.720514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:43.721197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:43.734346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-04b4a684-94ed-4290-b346-9927e5d5c0ad tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.196856 Jul 29 12:50:43.745540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 29/62] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:43 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:43.793094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:43.805547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-606b327c-bc82-4222-bc3a-d71311694b31 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.100895 Jul 29 12:50:43.806478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 34/63] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:43 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:44.216591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:44.217374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:44.224633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.225265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.226567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.227016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.291692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:44.299705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-527e1614-3c5a-489c-b4c3-dc419b05493e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1279 microversion: 2.1 time: 0.088135 Jul 29 12:50:44.300281 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 30/64] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:44 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:44.486363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:44.487482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:44.497024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.497897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.498412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.499260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.585765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:44.594979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:44.596960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:44.598081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-88f254c1-2425-49a8-94f9-73105f38d7c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.132263 Jul 29 12:50:44.598805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 35/65] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:44 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:50:44.757811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:44.759256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:44.765507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.766213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.767137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.767736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.828793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:44.829659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:44.837262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.837712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.838506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:44.838941 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:44.913293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:44.923198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ebeac347-0b36-4099-b72d-615e0d5f37cc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.100448 Jul 29 12:50:44.923780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 36/66] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:44 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:45.005602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:45.013616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cf691549-2d40-4244-a3b8-712ddd3e1909 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.260074 Jul 29 12:50:45.014691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 31/67] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:44 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:45.320392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:45.320996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:45.327419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:45.327914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:45.328654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:45.329327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:45.518410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:45.526928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-90cb53ba-da56-46f6-b982-9d86d111fb53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.210170 Jul 29 12:50:45.527845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 37/68] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:45 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:45.621254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:45.621893 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:45.628595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:45.629050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:45.629813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:45.630290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:45.696162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:45.706030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:45.708112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:45.709248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2a656d77-9696-4010-98ed-82fa586e270f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.091917 Jul 29 12:50:45.721849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 32/69] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:45 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:45.943796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:45.944408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:45.951168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:45.951613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:45.952410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:45.952999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.033461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:46.039163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:46.040481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:46.041568 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-725c80f0-0710-48ca-bdf7-1412642e12f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.101608 Jul 29 12:50:46.056490 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 38/70] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:45 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:46.060700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:46.061231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.065860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:46.066711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.297165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:46.305622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-568559c6-161f-4bb6-9310-2ee9a2ff4076 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.273653 Jul 29 12:50:46.306279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 33/71] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:46 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:46.553000 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:46.554421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:46.563623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:46.564554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.565695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:46.566470 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.733842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:46.734472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:46.756813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:46.757507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.758463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:46.759037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:46.773360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:46.783460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-68920d30-295f-41d6-ad81-a01bc87318f4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.238572 Jul 29 12:50:46.784280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 39/72] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:46 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:46.870675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:46.887868 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:46.889881 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:46.891863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fc9e82d1-7ed2-457f-9443-988856e80aed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.163196 Jul 29 12:50:46.898903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 34/73] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:46 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:47.069933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:47.070704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:47.078467 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.079190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.080086 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.080606 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.170174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:47.178117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5fc4dac5-acac-4436-a6e3-866e136c884b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.118507 Jul 29 12:50:47.190494 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 40/74] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:47 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:47.327551 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:47.328250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:47.339057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.343737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.344595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.345048 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.501644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:47.510875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-52c0b146-d0db-467d-a354-c0b1050ea437 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.187695 Jul 29 12:50:47.511460 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 35/75] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:47 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:47.804820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:47.805549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:47.813128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.813128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.813670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.814074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.923863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:47.927557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:47.939197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.940035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:47.941186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:47.941860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:48.033057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:48.046302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:48.060146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bccd43d6-0996-4aeb-8a91-e42aba6bd94d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.258633 Jul 29 12:50:48.060716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:48.061399 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 41/76] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:47 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:48.066709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:48.067879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c4fd5388-8d0f-48e2-beb0-ea76ad4e499e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.151124 Jul 29 12:50:48.068797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 36/77] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:47 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:50:48.200798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:48.202365 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:48.209668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:48.210648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:48.212023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:48.212748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:48.283256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:48.290721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:48.296355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8d469503-c5a2-40fe-9049-ef524842f760 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.098305 Jul 29 12:50:48.298961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 42/78] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:48 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:48.534767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:48.535473 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:48.543192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:48.544091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:48.545450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:48.546189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:48.726123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:48.734157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5e266f97-3fc2-4aa1-b382-15ccb71e8701 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.204895 Jul 29 12:50:48.734967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 37/79] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:48 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:49.084355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:49.085165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:49.093746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:49.094552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:49.104117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.105030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.106240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.106793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.107135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.107997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.110883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.111712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.229761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:49.253491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:49.257546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:49.262360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-55cf5a4a-f112-4236-8d10-855363b76983 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.172493 Jul 29 12:50:49.280713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 38/80] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:49 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:50:49.302588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:49.319963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ea5a76c6-be43-48ed-bf5b-eaf4d4a852ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.239960 Jul 29 12:50:49.320540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 43/81] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:49 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:49.323307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:49.323926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:49.331401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.339200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.341873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.342552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.424413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:49.433027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0bff8e43-c8a9-4dd5-b78d-4c3a41ae8e1f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.116609 Jul 29 12:50:49.434500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 39/82] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:49 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:49.756026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:49.756714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:49.765092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.766078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.767080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:49.768647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:49.978564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:49.988986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cdc3b523-1ab7-41b0-a4de-9598624053f1 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.236238 Jul 29 12:50:49.989985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 44/83] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:49 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:50.291083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:50.291690 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:50.298798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:50.299440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:50.300424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:50.301032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:50.350072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:50.350566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:50.363369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:50.364245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:50.365058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:50.367130 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:50.396141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:50.400787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:50.409580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:50.411673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:50.413672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-26a871df-93d5-4ea5-8597-90de560d8ab1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1284 microversion: 2.20 time: 0.125597 Jul 29 12:50:50.415528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 40/84] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:50 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:50.455009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:50.456392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:50.465894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:50.466345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:50.467117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:50.467586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:50.613787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:50.622452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-215ceb09-6251-45b9-bb4b-18a95bd66590 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1244 microversion: 2.1 time: 0.172148 Jul 29 12:50:50.624953 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 41/85] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:50 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1244 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:50.689030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:50.697213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d2eda24f-b2e7-4c8c-814f-217666eaf225 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.353179 Jul 29 12:50:50.698118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 45/86] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:50 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:51.023871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:51.024660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:51.029511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:51.039268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.039721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.040563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.040998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.102847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:51.185380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=14 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:51.452820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:51.454178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:51.465003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=36 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:51.473675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.482377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.483540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.484935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.622662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:51.633050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:51.634598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:51.635902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a0d3f2ae-7e70-46f6-9341-a624e2506083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1276 microversion: 2.20 time: 0.187964 Jul 29 12:50:51.636927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 46/87] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:51 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:51.648112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:51.648921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:51.657702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.658599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.659666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.660380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.715830 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:51.725230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f2fb2384-f5a0-4c79-a787-d46da489476e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.707723 Jul 29 12:50:51.738537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 42/88] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:51 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:51.745260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:51.746038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:51.752712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.753211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.754300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:51.754941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:51.767359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:51.775104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fcd52a7f-a674-40c0-b6df-54bdc445b1fa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1292 microversion: 2.1 time: 0.132829 Jul 29 12:50:51.778625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 47/89] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:51 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1292 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:52.231295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:52.246203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9628b2d4-8eda-4a22-95f9-e55fc71104d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.506534 Jul 29 12:50:52.247079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 43/90] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:51 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:52.662786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:52.663451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:52.675789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:52.676246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:52.681862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:52.682424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:52.752769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:52.754011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:52.763528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:52.765298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:52.767556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:52.769470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:52.847670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:52.856377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:52.857958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:52.866197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4bd03149-b8fe-4e6a-968e-996934e9a7af tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1338 microversion: 2.20 time: 0.209994 Jul 29 12:50:52.866811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 48/91] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:52 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:52.890296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:52.890968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:52.910910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:52.911592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:52.912552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:52.913156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.121996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:53.132741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7e577625-0457-4a6a-8a66-99cab5ac41bc tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.384897 Jul 29 12:50:53.133846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 44/92] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:52 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:53.140867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-62f95f73-8761-4fd9-935d-a7afa0359648 req-d79943b1-20bb-4f0c-b4a0-0a6481777a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1896a4-4e17-42e2-be2b-0fb84053871e", "tag": "7460e3cb-918d-47f8-ab19-9563c7dc0751"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:53.158146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-62f95f73-8761-4fd9-935d-a7afa0359648 req-d79943b1-20bb-4f0c-b4a0-0a6481777a8b service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.158855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-62f95f73-8761-4fd9-935d-a7afa0359648 req-d79943b1-20bb-4f0c-b4a0-0a6481777a8b service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.189802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-62f95f73-8761-4fd9-935d-a7afa0359648 req-d79943b1-20bb-4f0c-b4a0-0a6481777a8b service nova] Creating event network-changed:7460e3cb-918d-47f8-ab19-9563c7dc0751 for instance ed1896a4-4e17-42e2-be2b-0fb84053871e on hv-cinder-81914 Jul 29 12:50:53.189802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-62f95f73-8761-4fd9-935d-a7afa0359648 req-d79943b1-20bb-4f0c-b4a0-0a6481777a8b service nova] Acquired lock "compute-rpcapi-router" {{(pid=129323) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 12:50:53.189802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.190673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.191910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.192571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.209791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.compute.rpcapi [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 12:50:53.211146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] Releasing lock "compute-rpcapi-router" {{(pid=129323) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 12:50:53.252495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-549f9337-8fd6-4790-beb0-2ccbe3e8c64b None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117227 Jul 29 12:50:53.253126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 45/93] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:53.272695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:53.273601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:53.285861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.286417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.287323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.287838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.440977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:53.459402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c5c6f889-4d0a-4e10-86f0-b0e23b31dac6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1298 microversion: 2.1 time: 0.583445 Jul 29 12:50:53.461836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 49/94] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:52 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1298 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:53.893265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:53.894017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:53.901934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=8 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:50:53.904588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.905979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:53.907220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:53.907819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:54.048861 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:54.077478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:54.099863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:54.101520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-198c605a-feea-40d4-af05-86880da5a2b2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1338 microversion: 2.20 time: 0.212793 Jul 29 12:50:54.106050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 50/95] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:53 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:54.158921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:54.160411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:54.170347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:54.175964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:54.178171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:54.178735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:54.243183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:54.258223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a3c0a41b-cd41-454c-afce-22871bba0b1e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.992199 Jul 29 12:50:54.272396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 46/96] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:53 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:54.485109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:54.486355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:54.495598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:54.496052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:54.497208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:54.499267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:54.605163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:54.614978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9e6800a3-eedd-465b-b9ce-eea3cacb821f tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.462368 Jul 29 12:50:54.616103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 51/97] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:54 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:54.785079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:54.805785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7eeaa5de-275d-4a7d-a0cd-4fb6206d84ce tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1298 microversion: 2.1 time: 0.324913 Jul 29 12:50:54.814567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 47/98] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:54 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1298 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:50:55.131849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:55.132963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:55.147455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.147924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.148720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.149165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.282055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:55.282685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:55.303443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.303906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.310688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.312871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.591417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:55.600723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a7de77ff-11bb-40a8-a116-81ff7d6cc2bd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.325596 Jul 29 12:50:55.601298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 48/99] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:55 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:55.605763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-b66c19d0-04ea-4563-aca3-5e485f776e24 req-29664f78-c05f-4966-beda-29382caf7f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef193532-ce6d-490e-934b-900337d13fd7", "tag": "a20816b8-d6a9-4717-96f5-3ac642327781"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:55.625006 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-b66c19d0-04ea-4563-aca3-5e485f776e24 req-29664f78-c05f-4966-beda-29382caf7f72 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.625456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-b66c19d0-04ea-4563-aca3-5e485f776e24 req-29664f78-c05f-4966-beda-29382caf7f72 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.643082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-b66c19d0-04ea-4563-aca3-5e485f776e24 req-29664f78-c05f-4966-beda-29382caf7f72 service nova] Creating event network-changed:a20816b8-d6a9-4717-96f5-3ac642327781 for instance ef193532-ce6d-490e-934b-900337d13fd7 on hv-cinder-81914 Jul 29 12:50:55.666457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-b66c19d0-04ea-4563-aca3-5e485f776e24 req-29664f78-c05f-4966-beda-29382caf7f72 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063759 Jul 29 12:50:55.667138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 49/100] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:55.673015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:55.674288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:55.683099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.684123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.685029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.685635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.866040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:55.876371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5ab0bdd2-2bc7-4bb2-b8f3-264d5c1922f9 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.207914 Jul 29 12:50:55.877007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 50/101] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:55 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:55.881505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:55.882138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:55.891550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.892081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.893029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:55.893583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:55.986769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:56.000871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:56.003902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:56.005466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-756be2dd-aad6-463e-b2c3-025f0efdf225 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.878287 Jul 29 12:50:56.006335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 52/102] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:55 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:56.046838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:56.059330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1d72d7db-c098-49f7-b206-d0fe01bea87f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.181079 Jul 29 12:50:56.059925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 51/103] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:55 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:56.623196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:56.625133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:56.641791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:56.642580 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:56.645517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:56.647353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:56.904155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:56.904155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:56.916427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:56.917409 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:56.918802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:56.919407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:57.049706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:57.066756 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-57490c85-0a58-4b75-8334-30603381b8af tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.447329 Jul 29 12:50:57.068836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 53/104] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:56 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:57.082149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:57.083678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:57.098771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:57.100748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:57.102623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:57.103320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:57.176352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:57.188221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e298abe3-749e-422c-bebe-9ea6df6c197b tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.293033 Jul 29 12:50:57.189370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 52/105] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:56 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:57.197751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:57.199013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:57.208094 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:57.209297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:57.210543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:57.211374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:57.463358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:57.476031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4e6d7fee-fa6d-4db8-8630-3e4dba246833 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.285415 Jul 29 12:50:57.501713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 53/106] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:57 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:57.606391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:57.627606 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:57.629166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:57.633196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-90499a19-83e0-4bdc-8e4b-779d47c3d321 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.563043 Jul 29 12:50:57.634098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 54/107] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:57 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:50:57.698667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-21595a4c-83fd-4978-bf49-a9b755bef4c7 req-d0d5b624-37c9-4a8f-a7f0-2159b9b8c333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:57.709120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-21595a4c-83fd-4978-bf49-a9b755bef4c7 req-d0d5b624-37c9-4a8f-a7f0-2159b9b8c333 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:57.709567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-21595a4c-83fd-4978-bf49-a9b755bef4c7 req-d0d5b624-37c9-4a8f-a7f0-2159b9b8c333 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:57.744368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-21595a4c-83fd-4978-bf49-a9b755bef4c7 req-d0d5b624-37c9-4a8f-a7f0-2159b9b8c333 service nova] Creating event network-changed:beb71c54-25c8-4f1d-89fb-11a56e0858a6 for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb on hv-cinder-81914 Jul 29 12:50:57.750154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-21595a4c-83fd-4978-bf49-a9b755bef4c7 req-d0d5b624-37c9-4a8f-a7f0-2159b9b8c333 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140860 Jul 29 12:50:57.750896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 54/108] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:50:58.088395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:58.089004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:58.095954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.096404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.097163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.097592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.210334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:58.218289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:58.233650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.234196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.235002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.235463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.299459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:58.311497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-54f94c69-f73a-4efa-b55d-1fb371b452d7 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.226817 Jul 29 12:50:58.325912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 55/109] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:58 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:58.401457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:58.409840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f493100b-de6e-4fd3-bc10-22ee4785f2af tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.203814 Jul 29 12:50:58.410648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 55/110] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:58 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:58.499339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:58.505105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:58.511587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.511587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.511587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.511587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.659592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:58.660417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:58.661156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:58.667364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.668066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.669051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:58.669681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:58.671938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d346a256-0480-4043-99fd-1b29b1afaf4c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.176071 Jul 29 12:50:58.673452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 56/111] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:58 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:58.813615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:58.825951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:58.827386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:58.828529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9084db0c-6fd1-47e3-b46b-ad08b1cfb4a1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.176135 Jul 29 12:50:58.829090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 56/112] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:58 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:50:59.340608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:59.342032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:59.354771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.355561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.357230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.358462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.432106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:59.432721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:59.439142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.439932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.440919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.441680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.615469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:59.628879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-144e4491-fd17-45e4-ab9c-4291dee525e3 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.200084 Jul 29 12:50:59.630370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 57/113] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:59 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:59.653005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:50:59.661331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aafc05ca-489c-4021-b63e-2637aa97b7a6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.329735 Jul 29 12:50:59.662588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 57/114] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:59 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:50:59.695218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:59.695902 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:59.705861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.706329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.708456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.708912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.775403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-2485a46f-3a08-4dd2-834e-9807e78f0f5f req-4ad3bad6-ad3b-471f-bd46-05e6559f7072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef6fb941-1056-4618-8fd5-22dd72cf944f", "tag": "0d4aeb43-0283-4dc4-ac92-c1ff81c544b8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:50:59.788224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-2485a46f-3a08-4dd2-834e-9807e78f0f5f req-4ad3bad6-ad3b-471f-bd46-05e6559f7072 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.788681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-2485a46f-3a08-4dd2-834e-9807e78f0f5f req-4ad3bad6-ad3b-471f-bd46-05e6559f7072 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.802436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-2485a46f-3a08-4dd2-834e-9807e78f0f5f req-4ad3bad6-ad3b-471f-bd46-05e6559f7072 service nova] Creating event network-changed:0d4aeb43-0283-4dc4-ac92-c1ff81c544b8 for instance ef6fb941-1056-4618-8fd5-22dd72cf944f on hv-cinder-81914 Jul 29 12:50:59.807980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-2485a46f-3a08-4dd2-834e-9807e78f0f5f req-4ad3bad6-ad3b-471f-bd46-05e6559f7072 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Jul 29 12:50:59.809556 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 58/115] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:50:59.856449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:50:59.867821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:50:59.887797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.888252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:50:59.892677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:50:59.893167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:00.292725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:00.302341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:00.309114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:00.313241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-489de9c1-5992-4622-b327-d5faf7ba7f97 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.463809 Jul 29 12:51:00.315196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 59/116] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:50:59 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:00.378709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:00.389734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b881cf60-66c3-4027-b0a7-3affa41d00d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.700021 Jul 29 12:51:00.390684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 58/117] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:50:59 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:00.650664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:00.651207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:00.666131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:00.666786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:00.667554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:00.668019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:00.683343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:00.684065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:00.698364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:00.702373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:00.707056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:00.707608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:00.712357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:00.741749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:01.582665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:01.609544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-48348643-4c53-4e72-93ba-b3da87847d8e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.963040 Jul 29 12:51:01.612912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 60/118] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:00 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:01.622507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:01.633080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:01.661676 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:01.664073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:01.666553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:01.671685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:01.807535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:01.832099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5ea7c200-8893-404c-8b49-da713ba9d0b3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 1.151522 Jul 29 12:51:01.840398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 59/119] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:00 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:01.850097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:01.851192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:01.915184 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:01.915654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:01.916569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:01.917012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:02.235523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:02.251154 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:02.254779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:02.256427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-38229ac2-4301-4fbe-ab45-99c8d9eeea6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.642253 Jul 29 12:51:02.257717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 61/120] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:01 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:02.422456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:02.437229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6b0586f3-6757-4e28-9e29-b77280d9f737 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.595079 Jul 29 12:51:02.439390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 60/121] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:01 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:02.635937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:02.636570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:02.650207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:02.651091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:02.652064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:02.657269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:02.855304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:02.856488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:02.863547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:02.864243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:02.865408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:02.866108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:03.074511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:03.082885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-00eb382e-5700-45bc-8df1-8200f923c282 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.454137 Jul 29 12:51:03.084550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 62/122] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:02 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:03.207423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:03.282734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:03.283610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:03.294553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:03.295733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:03.296844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:03.297493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:03.459336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:03.474718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dc095b28-a28b-4397-ae30-4f0792bde7db tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.623603 Jul 29 12:51:03.475497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 61/123] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:02 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:03.480417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:03.482696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:03.483333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:03.491505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:03.495305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:03.497108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-77696601-0ef5-48d8-932c-c42590add461 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.219076 Jul 29 12:51:03.498819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 63/124] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:03 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:03.499470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:03.500002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:03.500795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:03.501241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:03.727367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:03.740667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-44b2787d-90cd-411b-a850-da3e1eb4477b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.263663 Jul 29 12:51:03.741539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 62/125] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:03 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:04.105582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:04.107723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:04.145857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:04.148348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:04.150070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:04.150642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:04.497879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:04.498539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:04.507788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:04.511478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:04.513223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:04.515076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:04.766087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:04.778432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1cb7acc3-87be-4d73-8794-2220547ffe66 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.677380 Jul 29 12:51:04.778938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 64/126] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:04 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:04.790198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:04.791010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:04.809637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:04.810365 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:04.811932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:04.812561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:05.001312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:05.018326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8f761b46-9b16-4d22-8958-1ef167324d4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.524983 Jul 29 12:51:05.022175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 63/127] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:04 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:05.043943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:05.048375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:05.066452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:05.066914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:05.067701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:05.068291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:05.083349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:05.096809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:05.099409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:05.100550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7f14932e-2e88-40fc-b6f3-b97a879f9149 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.320606 Jul 29 12:51:05.101102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 65/128] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:04 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:05.385494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:05.396040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e47cee53-efa0-41a2-8896-2b13086cc778 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.370098 Jul 29 12:51:05.398274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 64/129] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:05 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:05.596597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-311dfd0c-458d-4d74-936a-5b43658c9154 req-0c2178af-2c3d-416b-95c1-f9dda631a2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1896a4-4e17-42e2-be2b-0fb84053871e", "name": "network-vif-plugged", "status": "completed", "tag": "7460e3cb-918d-47f8-ab19-9563c7dc0751"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:05.609269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-311dfd0c-458d-4d74-936a-5b43658c9154 req-0c2178af-2c3d-416b-95c1-f9dda631a2af service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:05.610078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-311dfd0c-458d-4d74-936a-5b43658c9154 req-0c2178af-2c3d-416b-95c1-f9dda631a2af service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:05.628140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-311dfd0c-458d-4d74-936a-5b43658c9154 req-0c2178af-2c3d-416b-95c1-f9dda631a2af service nova] Creating event network-vif-plugged:7460e3cb-918d-47f8-ab19-9563c7dc0751 for instance ed1896a4-4e17-42e2-be2b-0fb84053871e on hv-cinder-81914 Jul 29 12:51:05.635548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-311dfd0c-458d-4d74-936a-5b43658c9154 req-0c2178af-2c3d-416b-95c1-f9dda631a2af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.443767 Jul 29 12:51:05.638278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 66/130] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:05.799956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:05.802414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:05.814971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:05.815430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:05.825901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:05.829045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.053298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:06.054833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:06.070671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:06.071122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.071897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:06.072331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.425503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:06.433163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-719a5976-0c91-4076-9743-711ad63f51a4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.396302 Jul 29 12:51:06.450502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 67/131] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:06 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:06.458703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:06.466438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:06.475339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:06.475894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.485803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:06.486596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.561146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:06.574538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-25f43659-ec01-4cf0-9593-b01262fe2306 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.778478 Jul 29 12:51:06.585996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 65/132] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:05 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:06.596546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:06.597704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:06.606133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:06.606928 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.608028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:06.608683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:06.830020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:06.843030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:06.845438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:06.847510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8bc49cc0-bdd6-4efb-8a04-6f73b23a369e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.395629 Jul 29 12:51:06.866016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 68/133] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:06 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:07.408758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:07.419442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7706dfd9-0098-4793-873d-7c540c873383 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.832003 Jul 29 12:51:07.421949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 66/134] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:06 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:07.462003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:07.462844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:07.470110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:07.474445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:07.475480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:07.476087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:07.602435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:07.603362 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:07.615847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:07.616612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:07.617697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:07.621527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:07.898936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:07.907734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3e02267a-6eca-4db7-b6de-96be8d012a2d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.449459 Jul 29 12:51:07.922901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 69/135] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:07 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:07.929904 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-5e4248cd-3c70-4757-af7e-b6fdb6e6347e req-d2e0b316-2ad8-429c-837e-a8054a7210d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ede090-2e12-43db-9393-9cb26deda854", "name": "network-vif-plugged", "status": "completed", "tag": "c4e2b023-7879-4e11-a3a4-d61a5cf343b4"}, {"server_uuid": "ef193532-ce6d-490e-934b-900337d13fd7", "name": "network-vif-plugged", "status": "completed", "tag": "a20816b8-d6a9-4717-96f5-3ac642327781"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:07.950427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-5e4248cd-3c70-4757-af7e-b6fdb6e6347e req-d2e0b316-2ad8-429c-837e-a8054a7210d3 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:07.951129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-5e4248cd-3c70-4757-af7e-b6fdb6e6347e req-d2e0b316-2ad8-429c-837e-a8054a7210d3 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:07.975962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-5e4248cd-3c70-4757-af7e-b6fdb6e6347e req-d2e0b316-2ad8-429c-837e-a8054a7210d3 service nova] Creating event network-vif-plugged:c4e2b023-7879-4e11-a3a4-d61a5cf343b4 for instance 84ede090-2e12-43db-9393-9cb26deda854 on hv-cinder-81914 Jul 29 12:51:07.976469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-5e4248cd-3c70-4757-af7e-b6fdb6e6347e req-d2e0b316-2ad8-429c-837e-a8054a7210d3 service nova] Creating event network-vif-plugged:a20816b8-d6a9-4717-96f5-3ac642327781 for instance ef193532-ce6d-490e-934b-900337d13fd7 on hv-cinder-81914 Jul 29 12:51:07.991728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-5e4248cd-3c70-4757-af7e-b6fdb6e6347e req-d2e0b316-2ad8-429c-837e-a8054a7210d3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066868 Jul 29 12:51:07.994621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 70/136] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:08.003490 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:08.004529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:08.012176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:08.022905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:08.024765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:08.025373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:08.216617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:08.253107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5d23bbde-56eb-46a7-ab86-f756ca2b9f03 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.656612 Jul 29 12:51:08.259218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 67/137] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:07 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:08.446668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:08.447618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:08.461039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:08.461742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:08.464812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:08.466522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:08.734907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:08.744051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:08.745558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:08.746705 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5590b103-f525-4ae1-a24a-e15441f34107 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.750973 Jul 29 12:51:08.772477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 71/138] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:07 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:08.929443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:08.930688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:08.940481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:08.942547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:08.946067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:08.951342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:09.249022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:09.259208 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6ee3b87e-dca7-42e0-837a-19fc139d9a83 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.333499 Jul 29 12:51:09.260291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 72/139] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:08 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:09.281472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:09.282114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:09.286290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:09.293879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:09.295463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:09.297762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:09.302080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d7b87028-8055-4ed8-b884-893baa6aa9a4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.859700 Jul 29 12:51:09.302794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 68/140] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:08 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:09.303914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:09.535606 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:09.544094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1c106f5a-40e7-4b8e-b56c-d2b9239a5be8 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.267302 Jul 29 12:51:09.547528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 73/141] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:09 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:09.770979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:09.771629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:09.799815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:09.800303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:09.801122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:09.801623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.011102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-545b504e-0fb1-4e1d-a4f8-e82aa802d3e5 req-10877eea-a62a-4636-8290-f29344f8de42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "name": "network-vif-plugged", "status": "completed", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:10.042894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-545b504e-0fb1-4e1d-a4f8-e82aa802d3e5 req-10877eea-a62a-4636-8290-f29344f8de42 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.042894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-545b504e-0fb1-4e1d-a4f8-e82aa802d3e5 req-10877eea-a62a-4636-8290-f29344f8de42 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.084707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-545b504e-0fb1-4e1d-a4f8-e82aa802d3e5 req-10877eea-a62a-4636-8290-f29344f8de42 service nova] Creating event network-vif-plugged:beb71c54-25c8-4f1d-89fb-11a56e0858a6 for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb on hv-cinder-81914 Jul 29 12:51:10.097236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-545b504e-0fb1-4e1d-a4f8-e82aa802d3e5 req-10877eea-a62a-4636-8290-f29344f8de42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089896 Jul 29 12:51:10.098887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 74/142] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:10.128066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:10.151233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:10.155353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:10.158368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3d7f89f7-988d-40a2-9c44-fdef2fcf6e46 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.391539 Jul 29 12:51:10.158986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 69/143] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:09 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:10.282328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:10.283210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:10.293422 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.294551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.304116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.307092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.328309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:10.329177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:10.343002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.343997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.347579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.348156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.656575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:10.667370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7afe58d1-7c78-4c3b-88b9-92a312a9b763 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.343591 Jul 29 12:51:10.673752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 70/144] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:10 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:10.680381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:10.686088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:10.701653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.705686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.706772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:10.707295 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:10.707869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:10.715927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-78ed0aa8-2e54-4f35-84a1-4e0b274ebfa3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1321 microversion: 2.1 time: 0.439315 Jul 29 12:51:10.737909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 75/145] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:10 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:10.894138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:10.903504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-70065b55-ef8e-449a-952e-8cbace0b0247 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1314 microversion: 2.1 time: 0.228371 Jul 29 12:51:10.905455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 71/146] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:10 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:11.180703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:11.181328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:11.191454 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.193765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.196191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.199114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.453633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:11.465391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:11.477133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:11.484855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f06d6749-6cee-40e9-94c1-32631701699b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.307991 Jul 29 12:51:11.488771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 76/147] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:11 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:11.699922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:11.701189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:11.715950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.716649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.717454 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.718065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.744111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:11.744726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:11.752615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=95 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:11.758688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.759508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.760557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.761319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.928660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:11.939121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-685debba-7297-4a5b-b342-0438d0d90d0c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1516 microversion: 2.1 time: 0.198854 Jul 29 12:51:11.940038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 77/148] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:11 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:11.946056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:11.946955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:11.953545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.954143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:11.955014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:11.955746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.008808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:12.024198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-afbb7a45-6417-4684-88f2-1532f046d539 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.328539 Jul 29 12:51:12.039879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 72/149] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:11 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:12.050940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:12.054151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:12.065482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.066373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.067654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.068449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.177948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lazy-loading 'flavor' on Instance uuid ef193532-ce6d-490e-934b-900337d13fd7 {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:51:12.213957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:12.218913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:12.229112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ee52ba86-6987-42ee-b9a6-01b2fe2a98fb tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1500 microversion: 2.1 time: 0.287536 Jul 29 12:51:12.245811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 78/150] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:11 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1500 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:12.261666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-202ab652-9372-4ebf-8bd2-1c2ce2a05aae req-2f253394-8230-4227-8935-736f33acd078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6fb941-1056-4618-8fd5-22dd72cf944f", "name": "network-vif-plugged", "status": "completed", "tag": "0d4aeb43-0283-4dc4-ac92-c1ff81c544b8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:12.281537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-202ab652-9372-4ebf-8bd2-1c2ce2a05aae req-2f253394-8230-4227-8935-736f33acd078 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.282363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-202ab652-9372-4ebf-8bd2-1c2ce2a05aae req-2f253394-8230-4227-8935-736f33acd078 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.306091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-202ab652-9372-4ebf-8bd2-1c2ce2a05aae req-2f253394-8230-4227-8935-736f33acd078 service nova] Creating event network-vif-plugged:0d4aeb43-0283-4dc4-ac92-c1ff81c544b8 for instance ef6fb941-1056-4618-8fd5-22dd72cf944f on hv-cinder-81914 Jul 29 12:51:12.312698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-202ab652-9372-4ebf-8bd2-1c2ce2a05aae req-2f253394-8230-4227-8935-736f33acd078 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070947 Jul 29 12:51:12.314467 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 79/151] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:12.367092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:12.398453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-71276040-2c17-4ba2-8fb4-9cecaf65f0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7/action" status: 200 len: 32 microversion: 2.1 time: 0.355998 Jul 29 12:51:12.401490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 73/152] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:51:12 2022] POST /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:51:12.436839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:12.443272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:12.472147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.474806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.476624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.482596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.524841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:12.531980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:12.566107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.582005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.582945 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:12.583418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:12.983217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:12.993935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dcb6345e-735d-4f1d-8974-6f740279c832 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.584112 Jul 29 12:51:13.023055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 80/153] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:12 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:13.061316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:13.063462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:13.088765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:13.093045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:13.097916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:13.098590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:13.425033 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:13.438422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:13.444192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:13.449965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f25bf45e-1f8e-403d-b57a-cf1a7959f946 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1405 microversion: 2.20 time: 0.941911 Jul 29 12:51:13.451042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 74/154] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:12 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1405 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:51:13.528519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:13.542808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-62656444-56c5-4df8-8a81-1f3b0af82861 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.493068 Jul 29 12:51:13.548082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 81/155] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:13 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:14.018242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:14.019110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:14.028113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:14.030355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:14.031472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:14.034894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:14.155091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d05309d9-f6df-42f4-b2af-8b97a50540b0"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:14.161438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:14.189545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:14.192395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:14.195200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:14.197028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:14.631526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:14.645205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-237735b5-8b95-4c0b-8e18-3ceb9759308e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.631737 Jul 29 12:51:14.650518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 75/156] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:14 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:14.667592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:14.673174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:14.688576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:14.692302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:14.695391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:14.697981 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:15.075788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:15.092717 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:15.096457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:15.098382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-73f4b97b-98a9-47a0-ae50-100b52ff9c02 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1597 microversion: 2.20 time: 0.438585 Jul 29 12:51:15.100133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 76/157] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:51:14 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1597 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:51:15.106204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:15.107102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:15.114791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:15.115949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:15.116983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:15.117566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:15.315387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-740cee18-6186-4708-be12-bb8ee2011e41 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "POST /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165338 Jul 29 12:51:15.329838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 82/158] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:51:14 2022] POST /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:15.352177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:15.352763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:15.380240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:15.380693 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:15.381480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:15.381940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:15.659313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3612f10b-997d-40ba-96de-eaccba7aa7bb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.327235 Jul 29 12:51:15.660555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 83/159] 10.222.0.66 () {60 vars in 1316 bytes} [Fri Jul 29 12:51:15 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:51:15.674838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:15.675707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:15.686572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:15.687024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:15.687807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:15.688244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:16.048789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:16.057052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-75f168b3-76ca-4da5-b68e-d01ae58ed10d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1366 microversion: 2.1 time: 0.955449 Jul 29 12:51:16.061273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 77/160] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:15 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1366 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:16.289138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:16.300312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d4478f51-3592-486e-89c4-71a9a9bd54ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.630506 Jul 29 12:51:16.305328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 84/161] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:15 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:17.081323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:17.081956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:17.096256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:17.096772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:17.097721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:17.098321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:17.326384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:17.327327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:17.340441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:17.341128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:17.342492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:17.343126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:17.430120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:17.441484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7ced3b3a-9b08-43c3-8120-cd65f84253a9 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1556 microversion: 2.1 time: 0.362231 Jul 29 12:51:17.442920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 78/162] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:17 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1556 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:17.472947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:17.474070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:17.488049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:17.488715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:17.490305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:17.490981 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:17.709616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a06bdfa6-f576-4940-b577-a3d3d8ed830b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245700 Jul 29 12:51:17.710275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 79/163] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:51:17 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:51:17.850434 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:17.863546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e6aeae95-fe96-4346-b347-b24bf820e3b8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.541161 Jul 29 12:51:17.865041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 85/164] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:17 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:18.886864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:18.887601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:18.897180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:18.897553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:18.898356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:18.898796 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:19.275133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-aa987385-ffdf-4159-a820-f8b26446cf7a req-0ce77285-cf55-4537-907e-80caaf83e5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:19.313487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-aa987385-ffdf-4159-a820-f8b26446cf7a req-0ce77285-cf55-4537-907e-80caaf83e5ab service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:19.314367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-aa987385-ffdf-4159-a820-f8b26446cf7a req-0ce77285-cf55-4537-907e-80caaf83e5ab service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:19.342515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-aa987385-ffdf-4159-a820-f8b26446cf7a req-0ce77285-cf55-4537-907e-80caaf83e5ab service nova] Creating event network-changed:beb71c54-25c8-4f1d-89fb-11a56e0858a6 for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb on hv-cinder-81914 Jul 29 12:51:19.352140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-aa987385-ffdf-4159-a820-f8b26446cf7a req-0ce77285-cf55-4537-907e-80caaf83e5ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080775 Jul 29 12:51:19.353638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 86/165] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:19.726314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:19.740613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14bb5c2d-1fe1-47c2-b528-ddfdea0f5c5f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.858140 Jul 29 12:51:19.741783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 80/166] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:18 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:20.767287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:20.767994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:20.780177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:20.780655 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:20.783558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:20.785010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:20.937231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-2cc2c4fa-93e0-4cbf-b344-b230be1e737a req-1bce246f-6e81-49b1-b966-f44264fa2007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef6fb941-1056-4618-8fd5-22dd72cf944f", "tag": "0d4aeb43-0283-4dc4-ac92-c1ff81c544b8"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:20.958650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-2cc2c4fa-93e0-4cbf-b344-b230be1e737a req-1bce246f-6e81-49b1-b966-f44264fa2007 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:20.959435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-2cc2c4fa-93e0-4cbf-b344-b230be1e737a req-1bce246f-6e81-49b1-b966-f44264fa2007 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:21.001985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-2cc2c4fa-93e0-4cbf-b344-b230be1e737a req-1bce246f-6e81-49b1-b966-f44264fa2007 service nova] Creating event network-changed:0d4aeb43-0283-4dc4-ac92-c1ff81c544b8 for instance ef6fb941-1056-4618-8fd5-22dd72cf944f on hv-cinder-81914 Jul 29 12:51:21.017565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-2cc2c4fa-93e0-4cbf-b344-b230be1e737a req-1bce246f-6e81-49b1-b966-f44264fa2007 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084825 Jul 29 12:51:21.028876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 81/167] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:21.243072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:21.258589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dfb3cde0-e4ce-4a44-af8d-f8129116d0ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.495566 Jul 29 12:51:21.273991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 87/168] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:20 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:22.299763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:22.300372 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:22.322435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=80 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:22.328549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:22.329358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:22.333812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:22.342570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:22.886481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:22.898975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-15856183-6ee2-4fdd-aed9-173aea8c88f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.606070 Jul 29 12:51:22.924582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 82/169] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:22 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:23.730925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8667289f-9799-460a-9d61-30d7d91f1d55 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Action: 'create', calling method: .version_select at 0x7f74a2277af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1362500141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9PbMf1YG0uU4aYVMyiMYDy9TW6jF8SrPP2tIivrTPQkFVR6SqM07wlkfO3wFWIBPF+Fcpfn0ToJcLvmg7GFLWt7avjhRaxpP7I6gvdfhfWb2FvKWNR0zdNBesIn17vAA=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:23.749918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-8667289f-9799-460a-9d61-30d7d91f1d55 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Getting quotas for project 13c13c269e5f46e1a8236c89377c2171. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:51:23.756923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-8667289f-9799-460a-9d61-30d7d91f1d55 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Getting quotas for user a1c132b2fdc14e7ca4ffb18109a0fa0d and project 13c13c269e5f46e1a8236c89377c2171. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:51:23.785101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8667289f-9799-460a-9d61-30d7d91f1d55 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.398921 Jul 29 12:51:23.786337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 88/170] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:51:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:23.926192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:23.926891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:23.940901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:23.941356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:23.942170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:23.942803 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:24.101854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:24.121111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-de2b819f-6b5d-4dd5-94da-9b8803bb3c9a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.198715 Jul 29 12:51:24.132929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 83/171] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:23 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:25.165860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:25.166847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:25.182957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:25.183623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:25.184489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:25.184929 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:25.348035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:25.358690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49787c84-59bb-4a5e-a6c9-7463d79595e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.198957 Jul 29 12:51:25.359273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 89/172] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:25 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:25.704985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:25.706463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:25.719481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:25.719943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:25.720986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:25.721427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:25.779455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:51:25.894699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0f4ad37a-e074-40e9-8ddd-ab96f9dbb2c4 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "DELETE /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 204 len: 0 microversion: 2.1 time: 0.201128 Jul 29 12:51:25.895469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 84/173] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:51:25 2022] DELETE /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:51:25.906334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:25.907216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:25.916211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:25.916946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:25.918008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:25.918630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:26.053220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:26.061752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6846b997-5697-4229-8c64-8e54eb6958b7 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.161916 Jul 29 12:51:26.062350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 90/174] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:25 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:26.380125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:26.380812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:26.386787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:26.387234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:26.388029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:26.388988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:26.545646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:26.554853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-66896047-9ff1-41da-8916-4ec5fe2af7cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.178866 Jul 29 12:51:26.555422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 85/175] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:26 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:27.083095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:27.083740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:27.090700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:27.091178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:27.092194 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:27.092770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:27.254784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:27.263104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-032a9719-1b35-4615-b9c5-95eb9e80c72e tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.184287 Jul 29 12:51:27.264293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 91/176] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:27 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:27.580622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:27.581263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:27.593717 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:27.594262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:27.595029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:27.595736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:27.776632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:27.785115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7f246801-7046-4a9f-b46d-88efdab1f8f1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.213228 Jul 29 12:51:27.786037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 86/177] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:27 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:28.287503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:28.288644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:28.296137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:28.297185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:28.298105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:28.298907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:28.535192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:28.547842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4ce7a777-63f8-4530-b7a4-5582ae6169d5 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.264594 Jul 29 12:51:28.557811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 92/178] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:28 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:28.806824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:28.807510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:28.817337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:28.819398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:28.825293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:28.829512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:29.088673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:29.097973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-382507b0-8efa-4be5-9d6e-3384837dcc06 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.295385 Jul 29 12:51:29.098551 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 87/179] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:28 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:29.570542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:29.571159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:29.577593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:29.578246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:29.579011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:29.579449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:29.716940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:29.725658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f22c5f6c-0421-4764-a8da-af93007d3267 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.158951 Jul 29 12:51:29.726250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 93/180] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:29 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:30.119200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:30.119810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:30.126378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:30.126833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:30.127629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:30.128067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:30.257855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:30.266284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c0668724-c14e-49d5-a8ec-e20c46598ffc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.150896 Jul 29 12:51:30.266891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 88/181] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:30 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:30.747231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:30.748784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:30.755604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:30.756245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:30.757631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:30.758236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:30.885414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:30.893744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d0e31865-ae5f-47df-9039-92160f746087 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.151087 Jul 29 12:51:30.894330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 94/182] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:30 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:31.287428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:31.288042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:31.294222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:31.295262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:31.296026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:31.296466 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:31.432453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:31.436026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:31.441045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3ee95d39-9ffb-4a56-bec1-923432421763 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.157435 Jul 29 12:51:31.441608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 89/183] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:31 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:31.915272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:31.916150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:31.923086 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:31.923545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:31.924331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:31.924772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:32.063734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:32.071661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f029edd8-d1fe-4daa-8ca2-fd2e02c97f04 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.160691 Jul 29 12:51:32.072224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 95/184] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:31 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:32.464406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:32.465015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:32.472309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:32.472772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:32.473507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:32.473966 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:32.601369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:32.609541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e2e0a206-00e1-486b-85b1-4adf20122762 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.150923 Jul 29 12:51:32.610157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 90/185] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:32 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:33.093030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:33.093638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:33.100304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:33.100752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:33.101504 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:33.101985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:33.256184 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:33.264800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:33.268119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2d78a134-e428-4f1e-a30c-857508024e62 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1552 microversion: 2.1 time: 0.179583 Jul 29 12:51:33.269164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 96/186] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:33 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:33.633812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:33.634450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:33.641066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:33.641522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:33.642309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:33.642752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:33.832550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:33.842151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ba2f93b9-217b-4b9e-a6a0-14bd754d8367 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.211506 Jul 29 12:51:33.843059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 91/187] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:33 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:33.948175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-a8542744-b346-4bc7-91db-b1287a6bec9d req-2b7862ef-80ff-4b4f-8d98-89e2e4ad62d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ede090-2e12-43db-9393-9cb26deda854", "name": "network-vif-deleted", "tag": "c4e2b023-7879-4e11-a3a4-d61a5cf343b4"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:33.955599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=4 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:33.963336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-a8542744-b346-4bc7-91db-b1287a6bec9d req-2b7862ef-80ff-4b4f-8d98-89e2e4ad62d6 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:33.964206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-a8542744-b346-4bc7-91db-b1287a6bec9d req-2b7862ef-80ff-4b4f-8d98-89e2e4ad62d6 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:33.991867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-a8542744-b346-4bc7-91db-b1287a6bec9d req-2b7862ef-80ff-4b4f-8d98-89e2e4ad62d6 service nova] Creating event network-vif-deleted:c4e2b023-7879-4e11-a3a4-d61a5cf343b4 for instance 84ede090-2e12-43db-9393-9cb26deda854 on hv-cinder-81914 Jul 29 12:51:33.997089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-a8542744-b346-4bc7-91db-b1287a6bec9d req-2b7862ef-80ff-4b4f-8d98-89e2e4ad62d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054981 Jul 29 12:51:33.998121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 97/188] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:34.292360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:34.293464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:34.300546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:34.301256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:34.302383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:34.303145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:34.380984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a4fdcc0dde49009f4e55d25af4da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9210aacd9bd4593a85429fe1768e28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:34.393205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6dd4f320-a61e-4b84-bf26-5c5ab2c059ae tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 200 len: 1345 microversion: 2.1 time: 0.104396 Jul 29 12:51:34.394366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 92/189] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:34 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:34.867016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:34.868054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:34.878751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:34.879210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:34.880018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:34.880453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:35.018589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:35.026146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0dd373f4-d197-4cd0-868b-f9b4a3002854 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.166754 Jul 29 12:51:35.026719 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 98/190] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:34 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:35.415462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:35.416141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:35.424133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:35.424995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:35.425964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:35.426584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:35.441465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] HTTP exception thrown: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Request method failure captured: Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 HTTP/1.1 Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eOYHbLv44-wECNN5ZGgTlldxZJawSdbmhTcWj8wVGYjp6I-qTMpgTPSDAnJGwjh562URbDRHVu7QyVB7Xcds-zYb6S70roUz4-LjGoEBzSsy7HTiLeXyWBRAt5LMOfkV-xslpaqYQO9-yzu8ULBv7gvSyfvF_dv-TYXggsfDDUs_k Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:51:35.445976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b3a4fdcc0dde49009f4e55d25af4da7c Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.447389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '84ede090-2e12-43db-9393-9cb26deda854'} Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:51:35.448212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.449585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.450792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Returning 404 to user: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:51:35.450792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-702f391f-fa32-4aa7-a4f3-0eebd2d32002 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 404 len: 111 microversion: 2.1 time: 0.036057 Jul 29 12:51:35.450792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 93/191] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:35 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:51:35.570962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:35.573059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:35.579461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:35.579918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:35.580690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:35.581129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:35.595224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] HTTP exception thrown: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Request method failure captured: Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854/os-volume_attachments HTTP/1.1 Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eOYHbLv44-wECNN5ZGgTlldxZJawSdbmhTcWj8wVGYjp6I-qTMpgTPSDAnJGwjh562URbDRHVu7QyVB7Xcds-zYb6S70roUz4-LjGoEBzSsy7HTiLeXyWBRAt5LMOfkV-xslpaqYQO9-yzu8ULBv7gvSyfvF_dv-TYXggsfDDUs_k Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:51:35.600031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b3a4fdcc0dde49009f4e55d25af4da7c Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.601307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'server_id': '84ede090-2e12-43db-9393-9cb26deda854'} Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:51:35.602035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:35.603099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:35.604279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Returning 404 to user: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:51:35.604279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2ab958a7-db8b-4233-a872-d88a54be4f59 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034519 Jul 29 12:51:35.604279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 99/192] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:51:35 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:51:36.047212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:36.047739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:36.053701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:36.054162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:36.054911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:36.055343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:36.187152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:36.195799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-57e4a55d-9996-4f70-a23a-e1bd08200a79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.152707 Jul 29 12:51:36.196452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 94/193] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:36 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:36.800806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:36.801307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:36.808042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:36.808490 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:36.809252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:36.809688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:36.823410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] HTTP exception thrown: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Request method failure captured: Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: DELETE /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 HTTP/1.1 Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eOYHbLv44-wECNN5ZGgTlldxZJawSdbmhTcWj8wVGYjp6I-qTMpgTPSDAnJGwjh562URbDRHVu7QyVB7Xcds-zYb6S70roUz4-LjGoEBzSsy7HTiLeXyWBRAt5LMOfkV-xslpaqYQO9-yzu8ULBv7gvSyfvF_dv-TYXggsfDDUs_k Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:51:36.826110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b3a4fdcc0dde49009f4e55d25af4da7c Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.827637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '84ede090-2e12-43db-9393-9cb26deda854'} Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:51:36.828386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.829641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.831755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Returning 404 to user: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:51:36.831755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-62cc15e9-8861-4955-b8de-71568ae7457c tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "DELETE /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 404 len: 111 microversion: 2.1 time: 0.030654 Jul 29 12:51:36.831755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 100/194] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:51:36 2022] DELETE /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:51:36.837159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:36.837773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] [instance: 84ede090-2e12-43db-9393-9cb26deda854] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:36.846110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:36.846570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:36.847833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:36.848278 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:36.867108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] HTTP exception thrown: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Request method failure captured: Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 HTTP/1.1 Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eOYHbLv44-wECNN5ZGgTlldxZJawSdbmhTcWj8wVGYjp6I-qTMpgTPSDAnJGwjh562URbDRHVu7QyVB7Xcds-zYb6S70roUz4-LjGoEBzSsy7HTiLeXyWBRAt5LMOfkV-xslpaqYQO9-yzu8ULBv7gvSyfvF_dv-TYXggsfDDUs_k Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:51:36.869761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f9210aacd9bd4593a85429fe1768e28d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: f9210aacd9bd4593a85429fe1768e28d Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-DeleteServersTestJSON-51071275 Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b3a4fdcc0dde49009f4e55d25af4da7c Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-DeleteServersTestJSON-51071275-project Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.871140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '84ede090-2e12-43db-9393-9cb26deda854'} Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:51:36.871785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. Jul 29 12:51:36.872821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:51:36.873749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] Returning 404 to user: Instance 84ede090-2e12-43db-9393-9cb26deda854 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:51:36.873749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1034b1b7-3eb3-4c6c-a42b-a960b99c30d6 tempest-DeleteServersTestJSON-51071275 tempest-DeleteServersTestJSON-51071275-project] 10.222.0.66 "GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854" status: 404 len: 111 microversion: 2.1 time: 0.036753 Jul 29 12:51:36.873749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 95/195] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:36 2022] GET /compute/v2.1/servers/84ede090-2e12-43db-9393-9cb26deda854 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:51:37.218359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:37.218884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:37.225398 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:37.225881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:37.226645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:37.227252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:37.395730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:37.404503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ebc328f8-6b8c-406d-9430-2a05d44d5864 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.190184 Jul 29 12:51:37.405558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 101/196] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:37 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:38.426927 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:38.428151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:38.434258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:38.434842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:38.435670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:38.437378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:38.919481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:38.930813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-235e610c-c5db-496c-8a90-4f670e288254 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.507931 Jul 29 12:51:38.931401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 96/197] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:38 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:39.953387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:39.954898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:39.964450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:39.965113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:39.966269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:39.966877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:40.162302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:40.170207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-20ad0dac-7106-4ccd-90c5-3eaa606e8563 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.221775 Jul 29 12:51:40.170778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 102/198] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:39 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:41.193595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:41.194344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:41.201548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:41.202106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:41.203175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:41.203675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:41.467408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:41.484431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-56eda765-f4a4-4c94-8804-c31de7c9c06d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.296141 Jul 29 12:51:41.499151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 97/199] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:41 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:42.507807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:42.509039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:42.515219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:42.517324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:42.518003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:42.518895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:42.519439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:42.676811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:42.687297 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8b2065c6-3d66-4549-9748-f738b2adcd00 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.183498 Jul 29 12:51:42.687922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 103/200] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:42 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:43.708849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:43.709592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:43.716110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:43.716558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:43.717326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:43.717754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:43.887557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:43.895788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ecf4a5bc-1eba-42d3-b0cd-ba8bf00214d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.190925 Jul 29 12:51:43.911045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 98/201] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:43 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:44.926894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:44.932063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:44.939657 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:44.940576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:44.941522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:44.943404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:45.197343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:45.209834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b19cb70c-f8f6-4dc5-a724-ffb3bbdef037 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.295887 Jul 29 12:51:45.213260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 104/202] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:44 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:46.243118 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:46.243873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:46.256922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:46.257969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:46.260586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:46.261269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:46.480409 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:46.494106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-329a519a-b5b1-41e5-9e9f-d50834a5b54f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.257967 Jul 29 12:51:46.505914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 99/203] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:46 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:47.517051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:47.517658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:47.539403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:47.540028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:47.541162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:47.541794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:47.917195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:47.927307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2e21c345-a0e7-4c61-b5d0-afb506b0ca22 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.414931 Jul 29 12:51:47.928838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 105/204] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:47 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:48.494988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c50e3946-907c-4edc-97e7-525310dde182 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: .version_select at 0x7f74a298dc10>, body: {"keypair": {"name": "tempest-keypair-146083784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo/cdX9dAj8hAqyvocr+zJ/UFvskdZ/HknKoqygUYCsFGZPTkQOIz/kJLg90DritO2+tUH0+MzRmOiFKyjTDku9pBAFRIKEyD9cx6C+Ku89GarL6pjk6JTJCzl1izogvQ=="}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:48.532624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-c50e3946-907c-4edc-97e7-525310dde182 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for project f36dffd2ab1643ed939ffe87e5928187. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:51:48.537145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-c50e3946-907c-4edc-97e7-525310dde182 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for user 03f312d5c7334ccc82be17c5dfe29aeb and project f36dffd2ab1643ed939ffe87e5928187. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:51:48.610615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c50e3946-907c-4edc-97e7-525310dde182 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.479456 Jul 29 12:51:48.611555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 100/205] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:51:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:48.949283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:48.951065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:48.957901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:48.958575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:48.959498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:48.960088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:49.197505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:49.214350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b8b07bae-ed76-472d-9ecd-2590ab0624ce tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.268424 Jul 29 12:51:49.214694 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 106/206] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:48 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:50.236299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:50.240660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:50.247120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:50.247477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:50.248246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:50.248678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:50.275702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1924217951", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "687edcc3-e1e0-42df-9df9-ceabe263b0fd"}], "security_groups": [{"name": "tempest-securitygroup--420454350"}], "key_name": "tempest-keypair-146083784", "user_data": "}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:50.435650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:50.445249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8f3b5d55-b62b-4a12-90cc-ac3d9bb137bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.214252 Jul 29 12:51:50.451153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 101/207] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:50 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:50.487871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.network.neutron [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] validate_networks() for [('687edcc3-e1e0-42df-9df9-ceabe263b0fd', None, None, None, None, None)] {{(pid=129324) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:51:50.990680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Flavor limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:51:50.991347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Image limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:51:50.991912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Flavor pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:51:50.992381 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Image pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:51:50.992797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:51:51.002708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:51.003158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:51.003964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:51.004403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:51.021734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for project f36dffd2ab1643ed939ffe87e5928187. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:51:51.025730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for user 03f312d5c7334ccc82be17c5dfe29aeb and project f36dffd2ab1643ed939ffe87e5928187. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:51:51.037401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Going to run 1 instances... {{(pid=129324) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:51:51.039737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129324) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:51:51.086362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-21973f76-3483-4637-8848-43ca4e0f1c01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.816022 Jul 29 12:51:51.087190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 107/208] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:51:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:51:51.098276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bb38d38e-ee1a-45e6-991e-437985ce52fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:51.098889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bb38d38e-ee1a-45e6-991e-437985ce52fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:51.171773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bb38d38e-ee1a-45e6-991e-437985ce52fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:51.179738 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bb38d38e-ee1a-45e6-991e-437985ce52fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1237 microversion: 2.1 time: 0.085704 Jul 29 12:51:51.180522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 102/209] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:51 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:51.475381 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:51.477980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:51.489850 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:51.490562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:51.492155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:51.492950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:51.726899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:51.737074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-846c7891-4141-4e24-ab3d-9a6da2702975 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.267890 Jul 29 12:51:51.738728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 108/210] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:51 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:52.201237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:52.201795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:52.209192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:52.210049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:52.210822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:52.211770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:52.300660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:52.311642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c0f2d317-bc97-486b-98e8-1602d72d1762 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1289 microversion: 2.1 time: 0.114830 Jul 29 12:51:52.312640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 103/211] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:52 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:52.765528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:52.766925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:52.774591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:52.775265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:52.776339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:52.777347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:52.995302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:53.007751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-547b8425-b1fb-44cc-af68-ee07bd44ca4b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.251189 Jul 29 12:51:53.022659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 109/212] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:52 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:53.333265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:53.333898 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:53.337201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:51:53.346407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:53.350501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:53.351486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:53.352086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:53.637596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:53.650765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cf114d1c-9d2a-4b34-97cc-d04b8554cddb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.320997 Jul 29 12:51:53.654365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 104/213] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:53 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:54.036813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:54.037872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:54.049470 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:54.049949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:54.050725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:54.051163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:54.214079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:54.240617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-358b978b-7c7b-4798-9784-5fef256740e2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.212834 Jul 29 12:51:54.242164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 110/214] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:54 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:54.523335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-74072048-6238-48ef-a269-e68cc3da6db7 req-6edf5e6c-fe8b-4f77-8d8e-8d5746eec35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d9675c-1827-4d5f-9ffc-2ec302ef475c", "tag": "798338a9-4e08-4c38-8f25-863991fc313a"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:51:54.544159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-74072048-6238-48ef-a269-e68cc3da6db7 req-6edf5e6c-fe8b-4f77-8d8e-8d5746eec35e service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:54.544651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-74072048-6238-48ef-a269-e68cc3da6db7 req-6edf5e6c-fe8b-4f77-8d8e-8d5746eec35e service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:54.556597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-74072048-6238-48ef-a269-e68cc3da6db7 req-6edf5e6c-fe8b-4f77-8d8e-8d5746eec35e service nova] Creating event network-changed:798338a9-4e08-4c38-8f25-863991fc313a for instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c on hv-cinder-81914 Jul 29 12:51:54.562789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-74072048-6238-48ef-a269-e68cc3da6db7 req-6edf5e6c-fe8b-4f77-8d8e-8d5746eec35e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044384 Jul 29 12:51:54.563398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 105/215] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:51:54.674888 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:54.675632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:54.682296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:54.682750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:54.683538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:54.683982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:54.847822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:54.855252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-04b3b86a-e209-46cf-9477-ad6b668ecf06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.184798 Jul 29 12:51:54.855811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 111/216] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:54 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:55.263210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:55.263891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:55.270051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:55.270497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:55.271253 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:55.271684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:55.398792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:55.406921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a1021039-24c1-45b5-8d33-1472f5f41bfa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.147879 Jul 29 12:51:55.407488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 106/217] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:55 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:55.878348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:55.878970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:55.885446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:55.885933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:55.886698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:55.887140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:56.015501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:56.022922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-92cf29c2-ca1e-4fe5-9298-41958d0e057d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.149075 Jul 29 12:51:56.023479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 112/218] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:55 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:56.428198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:56.428724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:56.434772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:56.435223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:56.435984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:56.436424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:56.561531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:56.569640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-30a4576d-6d1c-4691-9066-1b6cea90eb24 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.145400 Jul 29 12:51:56.570236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 107/219] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:56 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:57.044190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:57.044803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:57.051294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:57.051751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:57.052513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:57.052953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:57.181925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:57.189912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c6bb0d02-50b8-458d-825b-644006007570 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.150101 Jul 29 12:51:57.190481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 113/220] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:57 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:57.591101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:57.592288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:57.599570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:57.600379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:57.601764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:57.602230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:57.782732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:57.790317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-adbf0d7e-2fa8-40a4-b5ca-c4ffe002c3b9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.203432 Jul 29 12:51:57.790883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 108/221] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:57 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:51:58.210467 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:58.211078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:58.218114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:58.218562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:58.219313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:58.219745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:58.348201 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:58.355597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c32acc8d-cde4-4c6c-9606-e2aef09e6d53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.148906 Jul 29 12:51:58.356804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 114/222] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:58 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:58.811709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:58.812427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:58.818642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:58.819104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:58.819868 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:58.820310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:58.949435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:58.956933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c367322e-57fb-4ba9-aca6-51d26330e0c6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.149364 Jul 29 12:51:58.957506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 109/223] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:58 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:59.377043 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:59.377671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:59.384549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:59.385045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:59.385879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:59.386326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:59.517328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:51:59.524692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-927e806d-f738-43ba-8c1b-470404c4e4fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.151628 Jul 29 12:51:59.525249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 115/224] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:59 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:51:59.978448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:51:59.979046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:51:59.985037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:59.985483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:51:59.986259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:51:59.986692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:00.004806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:00.114017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:00.123447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b54f9556-792d-417d-ae85-f9c492ae657b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.148743 Jul 29 12:52:00.124023 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 110/225] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:51:59 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:00.545162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:00.545774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:00.552252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:00.553154 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:00.553466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:00.553940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:00.557915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:00.683200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:00.691338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b5a28264-57f0-40f1-84e5-b90a6be01449 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.150638 Jul 29 12:52:00.691916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 116/226] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:00 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:01.144147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:01.144736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:01.151091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:01.151608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:01.152404 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:01.152949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:01.176069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:01.256617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:01.257552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=6 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:01.261595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1878847970", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1362500141", "security_groups": [{"name": "tempest-secgroup-smoke-1258346835"}], "networks": [{"uuid": "0b270de4-4c73-44c1-a0b7-4465b60cd8a1"}], "block_device_mapping_v2": [{"uuid": "7f2cad67-e3e5-4c28-ac9f-9956545f6183", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:01.383090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.network.neutron [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] validate_networks() for [('0b270de4-4c73-44c1-a0b7-4465b60cd8a1', None, None, None, None, None)] {{(pid=129324) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:52:01.424462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:01.438237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-84e0e806-da09-446c-8b60-f11ea5ea8621 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1522 microversion: 2.1 time: 0.293626 Jul 29 12:52:01.438960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 111/227] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:01 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:01.713965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:01.714952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:01.734165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:01.734921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:01.737304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:01.739814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.028282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:02.044618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b0321ecc-113d-4a44-9c22-57df63983f25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.334730 Jul 29 12:52:02.045342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 112/228] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:01 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:02.153376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Flavor limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:52:02.155394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Image limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:52:02.155897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Flavor pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:52:02.156315 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Image pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:52:02.156725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:52:02.165515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:02.166013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.166872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:02.167304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.184640 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Getting quotas for project 13c13c269e5f46e1a8236c89377c2171. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:02.188553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Getting quotas for user a1c132b2fdc14e7ca4ffb18109a0fa0d and project 13c13c269e5f46e1a8236c89377c2171. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:02.247984 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Going to run 1 instances... {{(pid=129324) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:52:02.250023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f2cad67-e3e5-4c28-ac9f-9956545f6183',volume_size=None,volume_type=None)] {{(pid=129324) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:52:02.395685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-781839ad-fb38-4ee3-8d4c-cbc6102f4494 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.139646 Jul 29 12:52:02.396319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 117/229] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:52:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 12:52:02.407781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a0837793-6283-4f98-aae5-eea6de55b524 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:02.408415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a0837793-6283-4f98-aae5-eea6de55b524 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:02.463456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a0837793-6283-4f98-aae5-eea6de55b524 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:02.466436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:02.467016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:02.471836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a0837793-6283-4f98-aae5-eea6de55b524 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1089 microversion: 2.1 time: 0.067834 Jul 29 12:52:02.472785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 113/230] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:02 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:02.489247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:02.489906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.490976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:02.491292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.643974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:02.652103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5a4ef29f-9175-4ab6-9873-d3746abcb657 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1502 microversion: 2.1 time: 0.193639 Jul 29 12:52:02.654005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 118/231] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:02 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:02.671859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:02.672554 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:02.680164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:02.680864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.681813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:02.682272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:02.838728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:02.848516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9b47fc6b-c590-48db-86e3-84fb6e1f3573 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1516 microversion: 2.1 time: 0.180581 Jul 29 12:52:02.849096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 114/232] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:02 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:03.075601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:03.076769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:03.096102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:03.098851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:03.099782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:03.100241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:03.352669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:03.364812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4d17cfe3-4ec6-4266-9de9-69d13c9c5aa7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.297300 Jul 29 12:52:03.365615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 119/233] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:03 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:03.450501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-b04f6cc4-91b8-467c-b258-f19a2cc93314 req-c955d026-63a7-49e3-86b8-6a215ca963f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d9675c-1827-4d5f-9ffc-2ec302ef475c", "name": "network-vif-plugged", "status": "completed", "tag": "798338a9-4e08-4c38-8f25-863991fc313a"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:03.467346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-b04f6cc4-91b8-467c-b258-f19a2cc93314 req-c955d026-63a7-49e3-86b8-6a215ca963f2 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:03.467900 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-b04f6cc4-91b8-467c-b258-f19a2cc93314 req-c955d026-63a7-49e3-86b8-6a215ca963f2 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:03.482254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-b04f6cc4-91b8-467c-b258-f19a2cc93314 req-c955d026-63a7-49e3-86b8-6a215ca963f2 service nova] Creating event network-vif-plugged:798338a9-4e08-4c38-8f25-863991fc313a for instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c on hv-cinder-81914 Jul 29 12:52:03.490047 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-b04f6cc4-91b8-467c-b258-f19a2cc93314 req-c955d026-63a7-49e3-86b8-6a215ca963f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044479 Jul 29 12:52:03.490852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 115/234] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:03.497239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:03.498168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:03.515331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:03.518961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:03.523712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:03.525546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:03.673053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:03.683497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e3e164bf-3e71-4879-a286-4bc01b6b2c41 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1187 microversion: 2.1 time: 0.193985 Jul 29 12:52:03.685370 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 120/235] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:03 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:04.374675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:04.377114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:04.383682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.384132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.384906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.385344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.388577 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:04.389197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:04.396589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.397231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.398245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.398831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.416914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lazy-loading 'flavor' on Instance uuid ed1896a4-4e17-42e2-be2b-0fb84053871e {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:52:04.521072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b7a1e350-44fc-4d1c-9ccd-a428fabac90c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/action" status: 200 len: 32 microversion: 2.1 time: 0.150649 Jul 29 12:52:04.526038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 116/236] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:52:04 2022] POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:52:04.535839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:04.536536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:04.544813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.545607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.546984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.547827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.558996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:04.567748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-283f46a2-738c-4fcc-bcbc-6084a4639475 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.183246 Jul 29 12:52:04.579097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 121/237] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:04 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:04.708367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:04.712995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:04.734084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.734927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.736097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:04.736891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:04.754889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:04.764182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d47e128d-096f-4460-ba14-ca84100da36a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.233327 Jul 29 12:52:04.765011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 117/238] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:04 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:04.971516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:04.979207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f6863ef2-1c4f-4ec7-84a8-3751b4aa4d3c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1273 microversion: 2.1 time: 0.276645 Jul 29 12:52:04.979980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 122/239] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:04 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:05.590580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:05.591189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:05.597436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:05.597987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:05.598757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:05.599199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:05.736302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:05.743616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ddd4d545-201d-4ce0-80f9-cbe37e82e0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.156906 Jul 29 12:52:05.744341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 118/240] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:05 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:05.788494 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:05.790472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:05.798967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:05.799821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:05.800782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:05.801403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:05.930656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:05.938180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c2a75791-e26e-4162-8fa6-3488c2ce269a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.156003 Jul 29 12:52:05.938755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 123/241] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:05 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:06.000310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:06.000913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:06.007263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:06.007727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:06.008562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:06.009049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:06.205316 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:06.212880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-584f9fd1-8f8a-47ce-b719-de9e9d1a028c tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1273 microversion: 2.1 time: 0.216353 Jul 29 12:52:06.214127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 119/242] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:05 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:06.771028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:06.771654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:06.778924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:06.779696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:06.780553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:06.780997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:06.959853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:06.961216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:06.967880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:06.968582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:06.969659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:06.970292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:07.037865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:07.049188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0e446cd9-65dd-4a28-a9e2-1eb603b48bc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.281927 Jul 29 12:52:07.059736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 124/243] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:06 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:07.236108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:07.236994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:07.244231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:07.245498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:07.246569 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:07.247355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:07.377544 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:07.407405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2faff4ef-3414-4985-94c6-51ded08dabe1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.451364 Jul 29 12:52:07.409153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 120/244] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:06 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:07.513781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:07.522231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8f45c712-5c75-4498-ae16-569f55921e98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1273 microversion: 2.1 time: 0.289829 Jul 29 12:52:07.523152 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 125/245] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:07 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:08.080676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:08.081356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:08.091369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.091846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.092613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.094389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.253342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-109bf92a-3e79-4f05-a298-76a3294ce36a req-8dee27c9-7725-4178-b61b-d53e503da9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:08.275460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-109bf92a-3e79-4f05-a298-76a3294ce36a req-8dee27c9-7725-4178-b61b-d53e503da9cc service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.279875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-109bf92a-3e79-4f05-a298-76a3294ce36a req-8dee27c9-7725-4178-b61b-d53e503da9cc service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.298188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-109bf92a-3e79-4f05-a298-76a3294ce36a req-8dee27c9-7725-4178-b61b-d53e503da9cc service nova] Creating event network-changed:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:52:08.319236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-109bf92a-3e79-4f05-a298-76a3294ce36a req-8dee27c9-7725-4178-b61b-d53e503da9cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067276 Jul 29 12:52:08.321945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 126/246] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:08.402177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:08.412301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-68d56f85-1ab9-4654-bec5-0e14f081e76c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1362 microversion: 2.1 time: 0.335224 Jul 29 12:52:08.413018 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 121/247] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:08 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:08.433739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:08.434695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:08.441691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.447493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.448558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.449094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.547333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:08.547871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:08.567187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.567728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.568571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:08.569009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:08.766562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:08.780191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-de7256b8-85d5-494f-a68b-0ca9068f00ee tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.352336 Jul 29 12:52:08.781127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 127/248] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:08 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:08.849491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:08.857134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bd62477c-8296-46a7-8d37-afb19aaa0458 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.317219 Jul 29 12:52:08.864149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 122/249] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:08 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:09.435893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:09.436498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:09.443699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.444332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.445257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.446412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.689192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:09.701998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49b5c022-9ca2-4cbd-8edb-923838d9990b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1548 microversion: 2.1 time: 0.270548 Jul 29 12:52:09.703567 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 128/250] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:09 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1548 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:09.724261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:09.725480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:09.732557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.733320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.734188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.734816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.808032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:09.810324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:09.822802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.825861 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.826784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.827393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.836086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-69deac57-1311-4e69-bd98-00fec9d87b42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116331 Jul 29 12:52:09.837126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 123/251] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:52:09 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:09.880135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:09.881099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:09.888317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.888916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:09.889710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:09.890178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:10.039522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:10.052571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-33026438-da4e-4214-a139-7e698d4517f4 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.177843 Jul 29 12:52:10.053428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 124/252] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:09 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:10.216561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:10.231880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-960bc3a8-9e89-45d8-995a-a5ef314f094f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.429284 Jul 29 12:52:10.248086 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 129/253] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:09 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:11.074871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:11.076147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:11.083755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:11.084209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:11.089361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:11.089867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:11.240926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:11.253233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-25b29206-21da-4108-a38c-d58102a1fae6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.182647 Jul 29 12:52:11.254435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 125/254] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:11 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:11.254681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:11.256365 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:11.265678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:11.266555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:11.267731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:11.268336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:11.585103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:11.593488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e7d06b0a-a2e1-4758-9496-72fca4a99c21 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.344247 Jul 29 12:52:11.597923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 130/255] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:11 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:11.848125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-556fcaef-d74d-4264-bfec-49fab76e59b2 req-40547d01-2074-49aa-a773-18f8da99e460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d9675c-1827-4d5f-9ffc-2ec302ef475c", "tag": "798338a9-4e08-4c38-8f25-863991fc313a"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:11.864219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-556fcaef-d74d-4264-bfec-49fab76e59b2 req-40547d01-2074-49aa-a773-18f8da99e460 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:11.865149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-556fcaef-d74d-4264-bfec-49fab76e59b2 req-40547d01-2074-49aa-a773-18f8da99e460 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:11.881718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-556fcaef-d74d-4264-bfec-49fab76e59b2 req-40547d01-2074-49aa-a773-18f8da99e460 service nova] Creating event network-changed:798338a9-4e08-4c38-8f25-863991fc313a for instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c on hv-cinder-81914 Jul 29 12:52:11.891629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-556fcaef-d74d-4264-bfec-49fab76e59b2 req-40547d01-2074-49aa-a773-18f8da99e460 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049770 Jul 29 12:52:11.893171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 126/256] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:12.276996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:12.277684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:12.284114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:12.285006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=6 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:12.288086 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:12.289175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:12.290334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:12.296775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:12.513649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:12.522042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bff735a5-a541-4a41-8d44-4fb28f260db3 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.248713 Jul 29 12:52:12.522633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 131/257] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:12 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:12.612617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:12.616781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:12.617638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:12.634349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:12.634889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:12.635727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:12.636172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:13.122427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:13.127894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:13.144083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0059f868-b4c6-4236-aef6-d1555c870d79 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.531121 Jul 29 12:52:13.146147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 127/258] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:12 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:13.544358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:13.545713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:13.551297 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:13.554040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:13.554732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:13.555782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:13.556326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:13.857688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:13.858472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:13.869708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:13.871799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:13.872947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:13.874401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:13.934571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ce00ad8f-3094-4249-9522-535e6921942f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/ips" status: 200 len: 151 microversion: 2.20 time: 0.081384 Jul 29 12:52:13.935319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 128/259] 10.222.0.66 () {60 vars in 1289 bytes} [Fri Jul 29 12:52:13 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/ips => generated 151 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:52:14.013084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:14.028641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ab1f3549-cb3b-4b96-993b-7f5bcda13db9 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.484143 Jul 29 12:52:14.030457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 132/260] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:13 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:14.167792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:14.168569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:14.181537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:14.182035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:14.185257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:14.186711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:14.590820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:14.601699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5ed626ee-d3f1-40bc-9bc6-a498277788ec tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.438895 Jul 29 12:52:14.603041 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 129/261] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:14 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:15.056284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:15.056906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:15.063787 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:15.064509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:15.065564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:15.066173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:15.390400 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:15.404156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5f7cf6bc-4c4c-4ced-a4f0-a5c172baef0e tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.356430 Jul 29 12:52:15.407012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 133/262] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:15 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:15.623964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:15.625220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:15.642071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:15.644802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:15.649858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:15.650325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:15.869099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:15.882655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-88fb1118-69f0-42c2-901d-9da5d4808752 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.262631 Jul 29 12:52:15.884216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 130/263] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:15 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:16.433261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:16.434905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:16.457181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:16.457944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:16.458913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:16.459500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:16.464548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:16.649699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:16.655200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:16.675246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:16.679636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:16.680379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:16.682376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:16.682376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:16.686369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-12363517-d3cb-4b08-943c-a6fe9760bbaf tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.259117 Jul 29 12:52:16.698460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 134/264] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:16 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:16.750257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lazy-loading 'flavor' on Instance uuid 9a58e30f-f1a3-4c6b-8b99-00a393888dfb {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:52:16.913488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:16.914641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:16.952091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:16.954687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:16.956573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:16.957395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:17.143871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2e78a1b8-858b-4bb9-b3a0-7a335d3e6e60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/action" status: 202 len: 0 microversion: 2.20 time: 0.502808 Jul 29 12:52:17.148052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 131/265] 10.222.0.66 () {62 vars in 1319 bytes} [Fri Jul 29 12:52:16 2022] POST /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 12:52:17.156326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:17.157578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:17.168896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:17.169724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:17.170817 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:17.171523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:17.194320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:17.212115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e4a4f660-d654-477a-a341-50c25f719840 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.310003 Jul 29 12:52:17.214173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 135/266] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:16 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:17.422275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:17.435404 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:17.437109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:17.439017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d47a0966-bcb4-42d5-a227-0f8f0455ddcb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.289775 Jul 29 12:52:17.439698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 132/267] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:17 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:17.711750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:17.713012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:17.721842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:17.722299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:17.723091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:17.723529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:17.912151 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:17.920962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9af8ce28-43af-4723-a5bb-8d2f2971f469 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.212814 Jul 29 12:52:17.921644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 136/268] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:17 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:18.238553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:18.239241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:18.252070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:18.258431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:18.265660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:18.268368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:18.461913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:18.463260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:18.471102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:18.472333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:18.480949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:18.482264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:18.597102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:18.606760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a41a4d3f-99a2-4a66-bf3d-eda0585f77f0 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.372852 Jul 29 12:52:18.607517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 133/269] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:18 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:18.683807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:18.693252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:18.695092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:18.696392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9c61a0a3-6043-4d7f-9d79-c04cb3193368 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.238846 Jul 29 12:52:18.697731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 137/270] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:18 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:18.910873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b238450a-1ea1-4acc-9371-2dffa03ee6c6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Action: 'create', calling method: .version_select at 0x7f74a29a5040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-887022515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4pw9V3KgQUQi2eHvFyzJuZ6RNlQlADfGjm6cV1UKXVlt+rWkdzk5I3Q/WGVihNQLyJ5BdqMoRdyJi638T0O8OW5h/XnV/qy+aOONT4hhfGYeB4qkX9m1nSrZkxUQJ0iw=="}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:18.929624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-b238450a-1ea1-4acc-9371-2dffa03ee6c6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Getting quotas for project 15f411d81f95464389c9ea3c12cee88d. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:18.935505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-b238450a-1ea1-4acc-9371-2dffa03ee6c6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Getting quotas for user 07220936c8784339b62f22482264e234 and project 15f411d81f95464389c9ea3c12cee88d. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:18.944217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:18.945480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:18.953268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:18.953996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:18.954867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:18.955452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:18.960905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b238450a-1ea1-4acc-9371-2dffa03ee6c6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.281466 Jul 29 12:52:18.967537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 134/271] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:52:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:19.211840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:19.224610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5892b140-10a2-4cd6-a6ae-33588b93cb88 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.284174 Jul 29 12:52:19.238549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 138/272] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:18 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:19.630250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:19.631038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:19.638003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:19.638446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:19.639250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:19.639947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:19.733015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:19.733637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:19.744564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:19.750098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:19.751260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:19.752872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:19.976548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:19.987754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:19.988506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:19.992560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:19.998309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1ddf720d-77f3-4e13-8a02-3346fe7d9842 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.280682 Jul 29 12:52:19.999737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 139/273] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:19 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:20.005438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-78687c38-717d-4e01-94e6-479458ecadd4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.380209 Jul 29 12:52:20.006788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 135/274] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:19 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:20.246970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:20.247786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:20.259761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:20.260221 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:20.261002 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:20.268715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:20.507523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:20.516202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7b6f1a4c-5360-4d04-82cd-4c16e2c77c96 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.273227 Jul 29 12:52:20.521161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 140/275] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:20 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:20.647813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-9c0919d4-084e-4c4d-8c31-896e1726f26d req-09b13572-1a3b-450d-8037-c05393933740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "name": "network-vif-plugged", "status": "completed", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:20.673787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-9c0919d4-084e-4c4d-8c31-896e1726f26d req-09b13572-1a3b-450d-8037-c05393933740 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:20.674264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-9c0919d4-084e-4c4d-8c31-896e1726f26d req-09b13572-1a3b-450d-8037-c05393933740 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:20.708782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-9c0919d4-084e-4c4d-8c31-896e1726f26d req-09b13572-1a3b-450d-8037-c05393933740 service nova] Creating event network-vif-plugged:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:52:20.720219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-9c0919d4-084e-4c4d-8c31-896e1726f26d req-09b13572-1a3b-450d-8037-c05393933740 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076761 Jul 29 12:52:20.721090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 136/276] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:21.025332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:21.026779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:21.027549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:21.028446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:21.035008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:21.035466 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:21.036249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:21.036578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:21.036716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:21.037379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:21.038514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:21.039305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:21.219667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:21.231980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:21.233965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:21.235419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-13c69ffc-558e-48ed-9e57-44465206e15f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.216625 Jul 29 12:52:21.236095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 141/277] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:21 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:52:21.253504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:21.259470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-905344a8-fb60-41ce-9beb-84ab6d8f7137 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.236633 Jul 29 12:52:21.260044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 137/278] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:21 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:21.540603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:21.541320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:21.548216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:21.548679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:21.549446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:21.550397 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:21.690887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:21.699064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dd0954e6-9b0e-427a-b17a-708c9c313d45 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.162573 Jul 29 12:52:21.699646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 142/279] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:21 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:21.721939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-696453701", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:21.772063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] validate_networks() for None {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:52:22.261462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:22.262106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:22.269623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.270114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.270913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.271587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.332412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:52:22.332910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:52:22.333456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:52:22.334051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:52:22.334534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:52:22.345062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.349647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.350365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.351579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.376474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Getting quotas for project 048547025e6f4cbaba52cbc817a789e7. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:22.384877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Getting quotas for user 12712d8a4a80488caaee2e6c8a4a2625 and project 048547025e6f4cbaba52cbc817a789e7. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:22.407973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:52:22.415228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:52:22.464247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:22.474458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:22.475862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:22.477039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c8d4b8d1-13de-4baa-9010-38a81e507721 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.219765 Jul 29 12:52:22.478364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 143/280] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:22 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:52:22.485532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:22.486479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:22.488414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-00aa5c85-baa3-41c6-967c-1f1f26dd0f25 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770553 Jul 29 12:52:22.489540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 138/281] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:52:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:52:22.493665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.494240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.495073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.495599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.507467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f0d2b14e-1ea5-48a6-9708-6071a421f904 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:22.508622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f0d2b14e-1ea5-48a6-9708-6071a421f904 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:22.578756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f0d2b14e-1ea5-48a6-9708-6071a421f904 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:22.586951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f0d2b14e-1ea5-48a6-9708-6071a421f904 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1214 microversion: 2.1 time: 0.084638 Jul 29 12:52:22.594020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 139/282] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:22 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:22.684964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:22.694831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-08faa6c3-4fa1-42b1-93b0-8bbad8e50fbd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.215037 Jul 29 12:52:22.695433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 144/283] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:22 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:22.721670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:22.722311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:22.724484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:22.730684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.731331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.732105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:22.732547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:22.895682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:22.906385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5a21d6bc-7f0e-4fd6-939c-d3d92a7b065a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1261 microversion: 2.1 time: 0.189147 Jul 29 12:52:22.930639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 140/284] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:22 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:23.508136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:23.508753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:23.515741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.516195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.516981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.517420 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.609607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:23.610241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:23.622982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.623435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.624211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.624651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.682987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:23.691099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:23.694803 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:23.700299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:23.705446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f169bf2d-9f39-49c5-8a21-df53343c07c8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1266 microversion: 2.1 time: 0.099860 Jul 29 12:52:23.713099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e06a28d5-b3da-4830-a4de-07e94d0d5712 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.208689 Jul 29 12:52:23.713701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 145/285] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:23 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:23.714140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 141/286] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:23 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:23.724084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:23.725793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:23.733001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.733541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.734415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.734928 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.934070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:23.935076 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:23.941750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.942542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.943788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:23.944852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:23.970762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:23.987461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-72892b40-dd2c-476f-b791-45bdabfad829 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.267681 Jul 29 12:52:23.989600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 142/287] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:23 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:24.138720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:24.146583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9d932161-0da5-4260-80e2-6ebaf70029ed tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1445 microversion: 2.1 time: 0.216920 Jul 29 12:52:24.147153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 146/288] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:23 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1445 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:24.169435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:24.170012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:24.185142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:24.186051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:24.187133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:24.187784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:24.558980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:24.573337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-82ebbd9f-bdd3-4618-98e4-00fc3a0eed68 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1445 microversion: 2.1 time: 0.407500 Jul 29 12:52:24.590457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 143/289] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:24 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1445 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:24.727854 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:24.728692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:24.738420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:24.739047 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:24.746874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:24.747335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:24.749382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:24.749854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:24.755940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:24.756405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:24.763582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:24.764078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:24.928803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:24.939642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c2e4a5bc-86af-48fe-9d20-818dc80ddf51 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1272 microversion: 2.1 time: 0.215547 Jul 29 12:52:24.940285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 147/290] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:24 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:25.007074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:25.010823 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:25.011818 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:25.022229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:25.024286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:25.025160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:25.025625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:25.026451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:25.026896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:25.027799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b854cfc0-6e16-43bf-9c9b-f988db8bec09 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.294220 Jul 29 12:52:25.036584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 144/291] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:24 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:25.220349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:25.228600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fdf25b4d-265c-43ab-a745-4a435559bae4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.221862 Jul 29 12:52:25.229171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 148/292] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:25 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:25.961774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:25.963138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:25.970918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:25.971552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:25.972427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:25.972968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:26.052855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:26.053589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:26.060639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:26.061105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:26.062170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:26.062843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:26.207391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:26.216547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:26.218114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:26.219312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-440a1e94-9988-4fa5-9135-d2fe8279133f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.170685 Jul 29 12:52:26.220026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 149/293] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:26 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:52:26.253873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:26.254517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:26.261061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:26.262301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:26.263321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:26.263768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:26.468057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:26.479136 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-52b269ec-1171-442c-bf35-5237d13c5d53 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.521116 Jul 29 12:52:26.493083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 145/294] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:25 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:26.608082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:26.611802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:26.616841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a81cd7c8-36b4-411a-b093-bec0b8f9e896 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.369901 Jul 29 12:52:26.617398 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 150/295] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:26 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:27.242688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:27.243289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:27.253633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.254134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.254946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.255393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.260434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:27.266861 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-ea71dd32-d394-4ac3-bed4-d1a280c01191 req-11be1655-145b-412e-8ebc-61471dd449f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542654e1-517b-4e01-9292-25c451dd65df", "tag": "719340ce-6ff6-41f3-9011-1e026dc895e8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:27.277633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-ea71dd32-d394-4ac3-bed4-d1a280c01191 req-11be1655-145b-412e-8ebc-61471dd449f6 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.278392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-ea71dd32-d394-4ac3-bed4-d1a280c01191 req-11be1655-145b-412e-8ebc-61471dd449f6 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.293002 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-ea71dd32-d394-4ac3-bed4-d1a280c01191 req-11be1655-145b-412e-8ebc-61471dd449f6 service nova] Creating event network-changed:719340ce-6ff6-41f3-9011-1e026dc895e8 for instance 542654e1-517b-4e01-9292-25c451dd65df on hv-cinder-81914 Jul 29 12:52:27.304509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-ea71dd32-d394-4ac3-bed4-d1a280c01191 req-11be1655-145b-412e-8ebc-61471dd449f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041228 Jul 29 12:52:27.306665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 151/296] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:27.500755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:27.501442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:27.509936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.509936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.510747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.511180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.552207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:27.563160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:27.564828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:27.566094 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-425bf12f-5b6c-4a27-9278-d42ffe2b20bd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.327311 Jul 29 12:52:27.576454 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 146/297] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:27 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:27.638489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:27.639358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:27.646254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.646869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.647754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.648302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.652827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:27.660790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d1755640-f983-4fb7-9f42-2db69da2e528 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.164159 Jul 29 12:52:27.661658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 152/298] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:27 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:27.872834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:27.873327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:27.880551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.881146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.882161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:27.882634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:27.914500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1ee0ac33-3d87-4229-901d-a2fa78dd305c tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/ips" status: 200 len: 150 microversion: 2.1 time: 0.046225 Jul 29 12:52:27.915084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 153/299] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:52:27 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:28.099034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:28.106511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-55f26b8e-306a-4e99-919a-5e571702524a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.472229 Jul 29 12:52:28.107252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 147/300] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:27 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:28.589698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:28.591017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:28.601398 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:28.601899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:28.603218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:28.603971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:28.681889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:28.682501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:28.690805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:28.691257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:28.692255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:28.692763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:28.783820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:28.793638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:28.802269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:28.803475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-afe3a1bf-df98-4d5e-b360-079a1d2a57b7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.218119 Jul 29 12:52:28.804251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 154/301] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:28 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:28.948064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:28.956267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-de8d5bd7-f66b-49e3-b9e1-c3c7383305e1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.278082 Jul 29 12:52:28.956952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 148/302] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:28 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:29.127115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:29.127847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.137558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.138085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.139125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.139735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.298252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:29.312101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-941d1e46-8cc2-4cf4-b16b-37ad68151188 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1502 microversion: 2.1 time: 0.188710 Jul 29 12:52:29.312877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 155/303] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:29 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:29.328402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-c19aee48-da87-4b68-837a-cc6a91ff30b9 req-ded0a75f-3388-4066-8ff4-39ba7265bde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:29.333628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5a71098-c026-404b-9af4-c9c852333b94"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:29.336550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.342743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-c19aee48-da87-4b68-837a-cc6a91ff30b9 req-ded0a75f-3388-4066-8ff4-39ba7265bde2 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.344642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-c19aee48-da87-4b68-837a-cc6a91ff30b9 req-ded0a75f-3388-4066-8ff4-39ba7265bde2 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.346194 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.346938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.347905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.348392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.365707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-c19aee48-da87-4b68-837a-cc6a91ff30b9 req-ded0a75f-3388-4066-8ff4-39ba7265bde2 service nova] Creating event network-changed:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:52:29.375586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-c19aee48-da87-4b68-837a-cc6a91ff30b9 req-ded0a75f-3388-4066-8ff4-39ba7265bde2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051962 Jul 29 12:52:29.376792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 149/304] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:29.384223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b9f5a07-50c6-4405-a319-4dc398862a87"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:29.387192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] HTTP exception thrown: Cannot 'attach_volume' instance ed1896a4-4e17-42e2-be2b-0fb84053871e while it is in vm_state rescued Jul 29 12:52:29.388573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Request method failure captured: Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/os-volume_attachments HTTP/1.1 Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 74 Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eRa0q_DgInPevO1z84sH37ZI1Mvwr4czUglHFjXqXy7ltot0wnWU-IMbqJJ8NCi6rhIv8kM5Zk0N56Yf4tNk_aGZOt3sNgq46u91ql66RqyLU0QJZAJW1ZRzBtmEOHfuWdq_RCTt69PavK-gC4ddGmgJLnO60JNEZCVPEwnfStPcI Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:52:29.389113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 1dd24e8c0d214a0bb62578f9834a40a2 Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {"volumeAttachment": {"volumeId": "d5a71098-c026-404b-9af4-c9c852333b94"}} Jul 29 12:52:29.390777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Cannot 'attach_volume' instance ed1896a4-4e17-42e2-be2b-0fb84053871e while it is in vm_state rescued Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'server_id': 'ed1896a4-4e17-42e2-be2b-0fb84053871e', 'body': {'volumeAttachment': {'volumeId': 'd5a71098-c026-404b-9af4-c9c852333b94'}}} Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:52:29.395250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ed1896a4-4e17-42e2-be2b-0fb84053871e while it is in vm_state rescued Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:52:29.396668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ed1896a4-4e17-42e2-be2b-0fb84053871e while it is in vm_state rescued Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Returning 409 to user: Cannot 'attach_volume' instance ed1896a4-4e17-42e2-be2b-0fb84053871e while it is in vm_state rescued {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b47938ad-5eaf-478d-9f01-6418051902b5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061830 Jul 29 12:52:29.397999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 156/305] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:52:29 2022] POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 12:52:29.398583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.398583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.398583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.398583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.400107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:29.402414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.410447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.410909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.413405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.413885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.526404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c674a19f-7f8d-4cbc-90b4-4779ed182ac4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/action" status: 202 len: 0 microversion: 2.1 time: 0.129922 Jul 29 12:52:29.528749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 157/306] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:52:29 2022] POST /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:52:29.539520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:29.540054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.546882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.547366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.548164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.548589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.692839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:29.700628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1148b574-3fe3-4a2e-be2f-fa6b2c8d4eb5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1510 microversion: 2.1 time: 0.165527 Jul 29 12:52:29.701222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 158/307] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:29 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:29.826950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:29.827557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.833880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.834371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.835143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.835582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.968275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:29.976578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:29.978121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:29.979284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-70af1eab-76b1-45c0-b92a-2bda2c78a43c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.156280 Jul 29 12:52:29.979831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 159/308] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:29 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:52:29.984257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:29.984855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:29.990460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.990915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:29.991677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:29.992120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:30.129148 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:30.141371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-39ba0918-9367-43b9-b98d-b8ebee70b444 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.160226 Jul 29 12:52:30.142355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 160/309] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:29 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:30.664040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9e4d28b5-b15e-456d-9698-d2a45e483b30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.285396 Jul 29 12:52:30.664746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 150/310] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:52:29 2022] POST /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments => generated 194 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:30.723242 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:30.724438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:30.731869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:30.732321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:30.733252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:30.733872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:30.879287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:30.889678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aec504bc-d92e-4698-a4d9-9aed9f09b18f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1510 microversion: 2.1 time: 0.170575 Jul 29 12:52:30.890352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 161/311] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:30 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:31.003267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:31.004029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:31.010698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:31.011576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:31.012356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:31.012795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:31.173554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:31.174229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:31.180893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:31.181346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:31.182147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:31.182589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:31.326915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:31.335244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3d6bdeb1-ba6b-4ed2-88a9-3854b54745a5 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.165620 Jul 29 12:52:31.335824 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 162/312] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:31 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:31.349438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:31.358211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:31.359711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:31.360873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cb826e3b-4a3f-4053-bf67-5c8eceb7aba0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.362287 Jul 29 12:52:31.361426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 151/313] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:30 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:31.912029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:31.913962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:31.919873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:31.920447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:31.921304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:31.921754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:32.066925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:32.075198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-136f540b-47ca-4d68-8ada-c2abff36253d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1510 microversion: 2.1 time: 0.167187 Jul 29 12:52:32.075787 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 163/314] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:31 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:32.357387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:32.358206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:32.364970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:32.365869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:32.366235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:32.366670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:32.367239 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:32.384990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:32.385731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:32.393187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:32.393812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:32.394768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:32.395363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:32.524396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:32.533645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0c23f496-ee8d-4d39-9c96-da851d75fb63 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.180970 Jul 29 12:52:32.534727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 152/315] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:32 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:32.556181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:32.565335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:32.566987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:32.568146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-af95452f-b562-49dd-8535-03bd9114959d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.187490 Jul 29 12:52:32.569144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 164/316] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:32 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:52:33.096668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:33.097303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:33.099225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=12 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:33.105449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:33.105939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:33.106706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:33.107149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:33.242554 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:33.250564 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-78fd04a0-d502-42f6-af21-17930f99596a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1510 microversion: 2.1 time: 0.158152 Jul 29 12:52:33.251127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 153/317] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:33 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:33.555922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:33.556552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:33.563601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:33.564053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:33.564819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:33.565257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:33.591777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:33.592420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:33.599422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:33.599878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:33.600692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:33.601138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:33.747842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:33.757860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:33.759471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:33.760701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6679af8b-6d28-490c-b99a-cf9894723be8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.172942 Jul 29 12:52:33.761862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 154/318] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:33 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:52:33.908379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:33.915963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-780fbba0-9bff-4af0-8911-395cec3f5a0b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.363969 Jul 29 12:52:33.916518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 165/319] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:33 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:34.271592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:34.272198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:34.278636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.279080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.279827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.280259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.481203 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-64c0a161-fa39-4f8f-990a-7faf2d7b403b req-ce9b85f6-2a01-4492-bfbc-280c281fc4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542654e1-517b-4e01-9292-25c451dd65df", "name": "network-vif-plugged", "status": "completed", "tag": "719340ce-6ff6-41f3-9011-1e026dc895e8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:34.493223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-64c0a161-fa39-4f8f-990a-7faf2d7b403b req-ce9b85f6-2a01-4492-bfbc-280c281fc4a7 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.494536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-64c0a161-fa39-4f8f-990a-7faf2d7b403b req-ce9b85f6-2a01-4492-bfbc-280c281fc4a7 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.506727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-64c0a161-fa39-4f8f-990a-7faf2d7b403b req-ce9b85f6-2a01-4492-bfbc-280c281fc4a7 service nova] Creating event network-vif-plugged:719340ce-6ff6-41f3-9011-1e026dc895e8 for instance 542654e1-517b-4e01-9292-25c451dd65df on hv-cinder-81914 Jul 29 12:52:34.512559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-64c0a161-fa39-4f8f-990a-7faf2d7b403b req-ce9b85f6-2a01-4492-bfbc-280c281fc4a7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035553 Jul 29 12:52:34.513153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 166/320] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:34.560265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:34.567949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d2e32b2b-0ac5-4852-a2b8-3da5dc6641b6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1516 microversion: 2.1 time: 0.300084 Jul 29 12:52:34.568507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 155/321] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:34 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:34.798303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:34.800838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:34.815097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.815938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.817048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.817762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.936680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:34.937331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:34.944047 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.944501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.945312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:34.945756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:34.995020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:35.003613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:35.005508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:35.006804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2cd358be-15ae-4e0f-ade1-ff478e8492f5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1742 microversion: 2.20 time: 0.224102 Jul 29 12:52:35.007444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 167/322] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:34 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:35.138545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:35.146105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5f0b6e41-3b6f-4514-9636-dd44c0c26eb8 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.213724 Jul 29 12:52:35.146746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 156/323] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:34 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:35.956550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2eea062d-8eee-4c13-be74-71679945435d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'create', calling method: .version_select at 0x7f74a2162040>, body: {"keypair": {"name": "tempest-keypair-469386203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx73byKa1AVrF9KxL53yUrl+itP+tJ8mmrms2g3ap514pUFVVL9bBvmqNxTWjgQe+h5a3q0KKS2/dAtsGQLmhExcIQY6T+qCn58a6SBgB5xRREhhFWFck2WgZ65qbaXvQ=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:35.972767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-2eea062d-8eee-4c13-be74-71679945435d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:35.976517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-2eea062d-8eee-4c13-be74-71679945435d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for user 1dd24e8c0d214a0bb62578f9834a40a2 and project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:35.999254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2eea062d-8eee-4c13-be74-71679945435d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046407 Jul 29 12:52:35.999860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 168/324] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:52:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:36.031741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:36.032884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:36.039827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:36.040314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:36.041086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:36.041522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:36.168112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:36.168958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:36.175555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:36.176111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:36.176965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:36.177525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:36.200068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:36.250979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:36.259334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:36.260870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:36.262096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b270a25c-881f-4ac0-bd9c-a81f1a72c6d7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1742 microversion: 2.20 time: 0.234329 Jul 29 12:52:36.262637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 157/325] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:36 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1742 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:36.376857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:36.384903 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-16817d82-c64a-4480-8820-2e175d44050b tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1314 microversion: 2.1 time: 0.221078 Jul 29 12:52:36.385489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 169/326] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:36 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:37.285387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:37.286140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:37.292729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.293301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.294595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.295258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.409193 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:37.411044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:37.425356 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.429930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.431597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.434395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.451091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:37.461361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:37.463038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:37.464988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e6069d8e-b161-40c8-8ded-24aa8fdf81fb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1742 microversion: 2.20 time: 0.183980 Jul 29 12:52:37.465540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 158/327] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:37 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:37.470464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-250200773", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dd8fb12-1c94-4bff-a156-ebe21acefc2b"}], "security_groups": [{"name": "tempest-securitygroup--1527157153"}], "key_name": "tempest-keypair-469386203", "user_data": "}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:37.576671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] validate_networks() for [('3dd8fb12-1c94-4bff-a156-ebe21acefc2b', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:52:37.584257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:37.592401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e5a2f013-c096-4f62-92a5-1c1f0fb29f05 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1462 microversion: 2.1 time: 0.191210 Jul 29 12:52:37.593378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 170/328] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:37 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1462 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:37.637961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:37.638519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:37.644388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.644842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.645631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.646100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.671028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:52:37.759123 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7af5cdaf-8314-4ed2-907b-502da1dab226 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "DELETE /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 204 len: 0 microversion: 2.1 time: 0.125082 Jul 29 12:52:37.759696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 171/329] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:52:37 2022] DELETE /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 12:52:37.768587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:37.769273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:37.775211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.775657 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.776484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.776920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.908925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:37.916543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2c131704-7127-4130-b949-f2d260d94790 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1468 microversion: 2.1 time: 0.151949 Jul 29 12:52:37.917211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 172/330] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:37 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:37.954487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:52:37.954946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:52:37.955421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:52:37.955865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:52:37.956307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:52:37.965505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.966001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.966812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:37.967256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:37.984110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:37.988074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Getting quotas for user 1dd24e8c0d214a0bb62578f9834a40a2 and project 9cdcbcec39334733a5fa29ddc40c7a2d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:37.999565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:52:38.001793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:52:38.048411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b3e5fdfd-fe27-4e9c-97cc-db8470308a85 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.581744 Jul 29 12:52:38.048972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 159/331] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:52:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:52:38.059867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9f81ec00-10be-4c05-ba29-a5a246abf1c9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:38.060512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9f81ec00-10be-4c05-ba29-a5a246abf1c9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:38.068273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:38.126824 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9f81ec00-10be-4c05-ba29-a5a246abf1c9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:38.133697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9f81ec00-10be-4c05-ba29-a5a246abf1c9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1244 microversion: 2.1 time: 0.077863 Jul 29 12:52:38.134325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 173/332] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:38 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1244 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:38.489968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:38.490577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:38.499267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:38.500126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:38.500557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-f1fa9298-2812-43f4-ab4e-685a36fdc25d req-3f1e877b-6998-4386-997f-fc2b13da0cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "name": "network-vif-plugged", "status": "completed", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:38.501306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:38.502148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:38.514163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f1fa9298-2812-43f4-ab4e-685a36fdc25d req-3f1e877b-6998-4386-997f-fc2b13da0cf9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:38.514606 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f1fa9298-2812-43f4-ab4e-685a36fdc25d req-3f1e877b-6998-4386-997f-fc2b13da0cf9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:38.525753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-f1fa9298-2812-43f4-ab4e-685a36fdc25d req-3f1e877b-6998-4386-997f-fc2b13da0cf9 service nova] Creating event network-vif-plugged:beb71c54-25c8-4f1d-89fb-11a56e0858a6 for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb on hv-cinder-81914 Jul 29 12:52:38.530975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-f1fa9298-2812-43f4-ab4e-685a36fdc25d req-3f1e877b-6998-4386-997f-fc2b13da0cf9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 Jul 29 12:52:38.531761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 174/333] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:38.643894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:38.652307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:38.653841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:38.655024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-130004bb-ef79-4436-a652-1d2291d6f11c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1742 microversion: 2.20 time: 0.169602 Jul 29 12:52:38.655555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 160/334] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:38 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:38.938777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:38.939392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:38.945878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:38.946340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:38.947108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:38.947545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:39.079887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:39.087373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-09a4b0ed-2364-4d23-acee-b6e5615cf079 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1468 microversion: 2.1 time: 0.153049 Jul 29 12:52:39.087956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 175/335] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:38 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1468 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:39.154491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:39.155103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:39.161159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:39.161617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:39.162464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:39.162933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:39.226805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:39.234773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9b3723af-90c3-4e90-a0e2-59feef7037da tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1248 microversion: 2.1 time: 0.084251 Jul 29 12:52:39.235331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 161/336] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:39 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:39.678392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:39.678998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:39.685548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:39.686042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:39.686802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:39.687243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:39.819244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:39.828858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:39.830626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:39.832028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7c1979b2-8618-4b17-85b4-1f8b6ab6ff73 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1742 microversion: 2.20 time: 0.157438 Jul 29 12:52:39.832590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 176/337] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:39 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:40.107368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:40.107982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:40.114608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:40.115065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:40.115844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:40.116288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:40.253062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:40.256223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:40.256768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:40.256901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:40.264669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:40.264804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-494052ed-9634-467a-a2c7-1321f0ae7d08 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1468 microversion: 2.1 time: 0.161064 Jul 29 12:52:40.265242 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:40.266063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:40.266508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:40.270229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 162/338] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:40 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:40.327274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:40.334672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0a0b0b80-7e0d-41eb-9061-80098b8e6852 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1248 microversion: 2.1 time: 0.082420 Jul 29 12:52:40.335239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 177/339] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:40 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:40.622408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-387849124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-887022515", "security_groups": [{"name": "tempest-secgroup-smoke-967962281"}], "block_device_mapping_v2": [{"uuid": "c6629e0e-b8d6-4070-afe8-6481e55d4283", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0f4a2881-36c5-4430-8c99-da426c4cf08a"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:40.747983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] validate_networks() for [('0f4a2881-36c5-4430-8c99-da426c4cf08a', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:52:40.857733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:40.859179 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:40.866020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:40.866477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:40.867334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:40.867789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.019305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:41.031673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:41.033367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:41.035429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-44192786-10d3-4498-8d28-6985b4dd6545 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.182958 Jul 29 12:52:41.036012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 178/340] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:40 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:41.192152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:52:41.192666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:52:41.193220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:52:41.193700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:52:41.194271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:52:41.204569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:41.205217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.206075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:41.206516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.223237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Getting quotas for project 15f411d81f95464389c9ea3c12cee88d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:41.227134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Getting quotas for user 07220936c8784339b62f22482264e234 and project 15f411d81f95464389c9ea3c12cee88d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:41.284880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:41.285628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:41.289875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:52:41.292419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:41.292543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6629e0e-b8d6-4070-afe8-6481e55d4283',volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:52:41.292935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.293712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:41.294189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.530287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-16dd8cf9-6260-4c86-8e70-27e1fcff36f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.912343 Jul 29 12:52:41.531035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 163/341] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:52:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:52:41.542661 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:41.543767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:41.556757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:41.558402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.560968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:41.561610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:41.582633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:41.594199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e45bcf60-c345-4149-8ba5-62d3856883b1 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1468 microversion: 2.1 time: 0.313545 Jul 29 12:52:41.608148 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 179/342] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:41 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1468 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:41.621309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ae8bb6b8-fa61-4a4b-83d9-bdde130c5a91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: .version_select at 0x7f74a2182160>, body: {"keypair": {"name": "tempest-keypair-1791388067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqgC+Uuu2d27LaU7aRul072oR81LBx8mS/wntMhiyDgmMVYBU0XpblDIfgvb3fy9AIj8Dm26BjpIR0x03AYWWJaG9tiBFNx+e8WHHU5sCWzKZwT67ortNuviIVkiw0PMQ=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:41.667393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-ae8bb6b8-fa61-4a4b-83d9-bdde130c5a91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:41.677783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-ae8bb6b8-fa61-4a4b-83d9-bdde130c5a91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:41.744608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ae8bb6b8-fa61-4a4b-83d9-bdde130c5a91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133555 Jul 29 12:52:41.746827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 180/343] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:52:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:41.755777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-90e510c4-9612-4d0c-a0e8-2c4eb4a22f4c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:41.756690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-90e510c4-9612-4d0c-a0e8-2c4eb4a22f4c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:41.844327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90e510c4-9612-4d0c-a0e8-2c4eb4a22f4c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:41.852815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-90e510c4-9612-4d0c-a0e8-2c4eb4a22f4c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1093 microversion: 2.1 time: 0.104842 Jul 29 12:52:41.853783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 181/344] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:41 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:42.026150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:42.038442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-eef2bc1c-dd10-46f3-b9a2-9f18846d3e37 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1304 microversion: 2.1 time: 0.505967 Jul 29 12:52:42.041091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 164/345] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:41 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1304 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:42.060413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:42.061669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:42.088270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.088746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:42.089598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.090065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:42.393946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:42.404139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:42.405945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:42.407353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aa98bd07-1eed-4939-b44c-cda6e4423163 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.351664 Jul 29 12:52:42.425977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 182/346] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:42 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:42.630809 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:42.634483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:42.657428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.658673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:42.659773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.661512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:42.745591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-8f2fd463-8860-4be4-83a5-2d92ae4cb291 req-6e85e51c-a9cb-4921-9f1a-0cad1898676d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542654e1-517b-4e01-9292-25c451dd65df", "name": "network-vif-deleted", "tag": "719340ce-6ff6-41f3-9011-1e026dc895e8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:42.761414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-8f2fd463-8860-4be4-83a5-2d92ae4cb291 req-6e85e51c-a9cb-4921-9f1a-0cad1898676d service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.761886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-8f2fd463-8860-4be4-83a5-2d92ae4cb291 req-6e85e51c-a9cb-4921-9f1a-0cad1898676d service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:42.780932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-8f2fd463-8860-4be4-83a5-2d92ae4cb291 req-6e85e51c-a9cb-4921-9f1a-0cad1898676d service nova] Creating event network-vif-deleted:719340ce-6ff6-41f3-9011-1e026dc895e8 for instance 542654e1-517b-4e01-9292-25c451dd65df on hv-cinder-81914 Jul 29 12:52:42.794748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-8f2fd463-8860-4be4-83a5-2d92ae4cb291 req-6e85e51c-a9cb-4921-9f1a-0cad1898676d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052121 Jul 29 12:52:42.795972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 183/347] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:42.839386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12712d8a4a80488caaee2e6c8a4a2625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048547025e6f4cbaba52cbc817a789e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:42.855277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-da6c9c0b-33aa-4eb2-aa20-a0df4352fc9c tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 200 len: 1426 microversion: 2.1 time: 0.228064 Jul 29 12:52:42.857274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 165/348] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:42 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 1426 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:42.875563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:42.876265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:42.883623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.884292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:42.885209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:42.886367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.052822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:43.065839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:43.066732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:43.077865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7685db85-b4cb-4cad-9337-72ee7a976137 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1191 microversion: 2.1 time: 0.206489 Jul 29 12:52:43.078467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:43.078681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.079625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:43.080245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.096633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 184/349] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:42 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1191 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:43.270529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:43.279930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-06e5825f-f8ac-4119-b7c1-6d9619086197 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1302 microversion: 2.1 time: 0.218899 Jul 29 12:52:43.287438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 166/350] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:43 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1302 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:43.432566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:43.433183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:43.440518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:43.441443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.447120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:43.449503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.682240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:43.693230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:43.694779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:43.704239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-96ec4bcc-e895-4788-b3aa-cd89aa553d0f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.275648 Jul 29 12:52:43.720439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 185/351] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:43 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:43.878336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:43.878948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] [instance: 542654e1-517b-4e01-9292-25c451dd65df] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:43.897990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:43.898492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.907568 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:43.908308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:43.946768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] HTTP exception thrown: Instance 542654e1-517b-4e01-9292-25c451dd65df could not be found. Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Request method failure captured: Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df HTTP/1.1 Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49gDZVnuLbCOfLVXnylg2g5JkIO9GCNgblImZzBuGTVUOe4W2nT8hIhxnFDl4KkhRmTC9088_ErUfNOTZqpYYFrJUCVm1V-LVlCWbEsl7Np6RqBzz80OpIOmIGxRmlXMDnYsBvMyVmus1JiQsg3mS1EKhdkukNGo7KToGOpr58YMc6U Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 048547025e6f4cbaba52cbc817a789e7 Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesNegativeTest-1052001477 Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:52:43.948523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_048547025e6f4cbaba52cbc817a789e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/048547025e6f4cbaba52cbc817a789e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/048547025e6f4cbaba52cbc817a789e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/048547025e6f4cbaba52cbc817a789e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesNegativeTest-1052001477 Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 048547025e6f4cbaba52cbc817a789e7 Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesNegativeTest-1052001477 Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesNegativeTest-1052001477-project Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 12712d8a4a80488caaee2e6c8a4a2625 Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesNegativeTest-1052001477-project Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 542654e1-517b-4e01-9292-25c451dd65df could not be found. Jul 29 12:52:43.949989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '542654e1-517b-4e01-9292-25c451dd65df'} Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542654e1-517b-4e01-9292-25c451dd65df could not be found. Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:52:43.950802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542654e1-517b-4e01-9292-25c451dd65df could not be found. Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542654e1-517b-4e01-9292-25c451dd65df could not be found. Jul 29 12:52:43.952143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:52:43.953189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] Returning 404 to user: Instance 542654e1-517b-4e01-9292-25c451dd65df could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:52:43.955542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-458c64b8-7bd0-4542-b621-5582897bf625 tempest-VolumesNegativeTest-1052001477 tempest-VolumesNegativeTest-1052001477-project] 10.222.0.66 "GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df" status: 404 len: 111 microversion: 2.1 time: 0.081033 Jul 29 12:52:43.956451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 167/352] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:43 2022] GET /compute/v2.1/servers/542654e1-517b-4e01-9292-25c451dd65df => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:52:44.100329 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:44.102275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:44.119254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:44.124234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:44.127637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:44.128158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:44.307728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:44.308457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:44.320468 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:44.320933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:44.321743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:44.322742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:44.366715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:44.390240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1c39036a-530f-480a-9c14-93601baa29d6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1209 microversion: 2.1 time: 0.292509 Jul 29 12:52:44.391736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 186/353] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:44 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1209 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:44.608174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-676602200", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3"}], "security_groups": [{"name": "tempest-securitygroup--264538157"}], "key_name": "tempest-keypair-1791388067", "user_data": "}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:44.753315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:44.760931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-70605363-1e27-4e94-ad42-6c77d39e5018 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.457834 Jul 29 12:52:44.761503 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 168/354] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:44 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:44.782020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:44.782825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:44.790321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:44.790785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:44.791733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:44.792221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:44.927929 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.network.neutron [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] validate_networks() for [('2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3', None, None, None, None, None)] {{(pid=129324) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:52:45.181992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:45.190688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:45.200571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:45.203162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-05b8afef-7b85-4352-b65e-eeef6a7e9593 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.436957 Jul 29 12:52:45.205810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 169/355] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:44 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:45.418502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:45.419508 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:45.433538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:45.436334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:45.438071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:45.439133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:45.814089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:52:45.814625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image limits 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:52:45.814988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:52:45.815404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image pref 0:0:0 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:52:45.815967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.virt.hardware [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129324) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:52:45.830509 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:45.831240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:45.833292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:45.833939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:45.840837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:45.857325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4f6ec615-32dd-47f0-898b-3046b754d3e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.449758 Jul 29 12:52:45.859884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 170/356] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:45 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:45.867412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:52:45.874747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:52:45.880001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:45.881742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:45.895875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Going to run 1 instances... {{(pid=129324) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:52:45.899167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129324) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:52:45.904106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:45.907291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:45.908135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:45.908588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:45.978464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f7e8de16-745f-46a5-ba54-1523a7b9bcfe tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.375669 Jul 29 12:52:45.994780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 187/357] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:52:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:52:46.002254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bf2c8113-765b-458c-8e2e-d5ae9bb8fbaf tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:46.003919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bf2c8113-765b-458c-8e2e-d5ae9bb8fbaf tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:46.189082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bf2c8113-765b-458c-8e2e-d5ae9bb8fbaf tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:46.198584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bf2c8113-765b-458c-8e2e-d5ae9bb8fbaf tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1241 microversion: 2.1 time: 0.201681 Jul 29 12:52:46.203359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 188/358] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:45 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1241 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:46.228809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-ace83291-c61a-4dcb-ac4e-e2621b30aac3 req-b85956d4-6b6a-42aa-8f43-2beb85b03c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a714f7-cb41-49d2-a3d9-548b76a88ff0", "tag": "554bff31-bbb8-4e37-b051-7ae3996fa046"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:46.284197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-ace83291-c61a-4dcb-ac4e-e2621b30aac3 req-b85956d4-6b6a-42aa-8f43-2beb85b03c1a service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:46.284968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-ace83291-c61a-4dcb-ac4e-e2621b30aac3 req-b85956d4-6b6a-42aa-8f43-2beb85b03c1a service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:46.316886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-ace83291-c61a-4dcb-ac4e-e2621b30aac3 req-b85956d4-6b6a-42aa-8f43-2beb85b03c1a service nova] Creating event network-changed:554bff31-bbb8-4e37-b051-7ae3996fa046 for instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 on hv-cinder-81914 Jul 29 12:52:46.329495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-ace83291-c61a-4dcb-ac4e-e2621b30aac3 req-b85956d4-6b6a-42aa-8f43-2beb85b03c1a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124615 Jul 29 12:52:46.330928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 189/359] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:46.350355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:46.379648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:46.391075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:46.391735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:46.392665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:46.393278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:46.535642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:46.544084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8787d545-bfb7-4b57-86ea-51854f5ccb76 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.681911 Jul 29 12:52:46.557338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 171/360] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:45 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:46.658991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:46.669485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:46.671690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:46.673645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-843b1947-c5a7-45db-86af-c8d17c77ee6f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.340922 Jul 29 12:52:46.687378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 190/361] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:46 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:46.881083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:46.881983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:46.895731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:46.902353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:46.903484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:46.904104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.247961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:47.248726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:47.256918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:47.257746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.259233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:47.259769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.264815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:47.372617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:47.397793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c0044402-cf55-4b86-9c38-20b696d69cb1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1293 microversion: 2.1 time: 0.154799 Jul 29 12:52:47.398974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 191/362] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:47 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:47.540836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:47.556653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5093c919-4244-49d1-9c12-a0bc67b3f361 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.679976 Jul 29 12:52:47.569119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:47.571736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:47.573462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 172/363] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:46 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:47.581582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:47.582846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.583855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:47.584636 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.699040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:47.699648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:47.718326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:47.718814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.728653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:47.738260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:47.986292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:47.994539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e582cd03-1074-4103-b38b-e10f3a419064 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.432605 Jul 29 12:52:47.997551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 192/364] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:47 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:48.107142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:48.133074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:48.135128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:48.136856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14f94314-33ef-4038-a089-b147053bb345 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.442500 Jul 29 12:52:48.137415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 173/365] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:47 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:48.371571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-f01c6a4d-eaf3-4aec-b7b0-543ae975d1e0 req-b5b8ff87-86ef-471b-be68-28e2411a512e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e77e87a-7f63-4eb0-9357-1e907bb5cf68", "tag": "832e8a04-76aa-4ddd-a3f4-44fbaa7755b3"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:48.404765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f01c6a4d-eaf3-4aec-b7b0-543ae975d1e0 req-b5b8ff87-86ef-471b-be68-28e2411a512e service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:48.405549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f01c6a4d-eaf3-4aec-b7b0-543ae975d1e0 req-b5b8ff87-86ef-471b-be68-28e2411a512e service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:48.420822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:48.421698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:48.425904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:48.436575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:48.437247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:48.438339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:48.439360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:48.441231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-f01c6a4d-eaf3-4aec-b7b0-543ae975d1e0 req-b5b8ff87-86ef-471b-be68-28e2411a512e service nova] Creating event network-changed:832e8a04-76aa-4ddd-a3f4-44fbaa7755b3 for instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 on hv-cinder-81914 Jul 29 12:52:48.450288 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-f01c6a4d-eaf3-4aec-b7b0-543ae975d1e0 req-b5b8ff87-86ef-471b-be68-28e2411a512e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086643 Jul 29 12:52:48.455068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 193/366] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:48.517607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:48.526988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4b30cf00-05d0-4ddb-9816-4ccfba6dc55d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1311 microversion: 2.1 time: 0.109568 Jul 29 12:52:48.534376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 174/367] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:48 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:48.582075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:48.583003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:48.591485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:48.592067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:48.592946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:48.593502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:48.761896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:48.769987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ee1ad540-0b04-4d2b-82b9-d9742a0df483 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.193864 Jul 29 12:52:48.770572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 194/368] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:48 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:49.018272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:49.019509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:49.026816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.027580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.028674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.029470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.168713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:49.172086 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:49.187067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.188099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.189386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.190139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.252336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:49.271225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-80f19559-6c06-42c0-91d6-ffd62fae24d1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.256673 Jul 29 12:52:49.272444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 175/369] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:49 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:49.548089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:49.548993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:49.561722 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.562681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.563713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.564297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.681075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:49.696057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-abe9858b-23fe-47fb-acfe-627947ed699e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1299 microversion: 2.1 time: 0.151771 Jul 29 12:52:49.696634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 176/370] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:49 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:49.740015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:49.755342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:49.757203 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:49.763618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8ed2fa0f-2169-4570-a8b3-d7631240b6e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.603512 Jul 29 12:52:49.764913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 195/371] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:49 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:49.793725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:49.794450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:49.820523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.826792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:49.828683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:49.829531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:50.296406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:50.296787 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:50.309640 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:50.310469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:50.311558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:50.312204 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:50.432534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:50.449966 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5340a5c4-4b9b-402e-97cb-0bbe15062f1e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.661906 Jul 29 12:52:50.451958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 177/372] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:49 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:50.725124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:50.725713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:50.738482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:50.738938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:50.739723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:50.749535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:50.753969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:50.770061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8b0f92a1-d25a-4853-9f45-50f34a637f54 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.471925 Jul 29 12:52:50.771159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 196/373] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:50 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:50.791461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:50.793067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:50.818322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:50.824313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:50.828415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:50.831700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:51.138214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:51.148073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a50f3eaa-8838-4146-b639-3119d5e4677d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.430976 Jul 29 12:52:51.148654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 178/374] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:50 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:51.407932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:51.425839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:51.433386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:51.440108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2c138403-a043-428a-853c-432f3dd7ac22 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.648508 Jul 29 12:52:51.441035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 197/375] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:50 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:51.473650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:51.474970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:51.477099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=4 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:51.480486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=12 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:51.523772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:51.524016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:51.524778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:51.525222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:51.791337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:51.800080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:51.802767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:51.814566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d67cc64c-5b94-47b9-ac5e-55f5d6ccaefa tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.345392 Jul 29 12:52:51.826421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 179/376] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:51 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:51.826528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:51.826528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:51.826528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:51.826528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:51.832407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-6042774e-7d83-4591-99df-d312a8a88cc4 req-e375ac3c-1436-4d82-a776-f9ba9a4a614c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1159bd7-b7c9-4745-b0c5-9c5207d8291d", "tag": "3cabe18f-cd87-4cae-b162-144c5306bea8"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:51.874430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-6042774e-7d83-4591-99df-d312a8a88cc4 req-e375ac3c-1436-4d82-a776-f9ba9a4a614c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:51.874563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-6042774e-7d83-4591-99df-d312a8a88cc4 req-e375ac3c-1436-4d82-a776-f9ba9a4a614c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:51.893339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-6042774e-7d83-4591-99df-d312a8a88cc4 req-e375ac3c-1436-4d82-a776-f9ba9a4a614c service nova] Creating event network-changed:3cabe18f-cd87-4cae-b162-144c5306bea8 for instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d on hv-cinder-81914 Jul 29 12:52:51.916159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-6042774e-7d83-4591-99df-d312a8a88cc4 req-e375ac3c-1436-4d82-a776-f9ba9a4a614c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098222 Jul 29 12:52:51.919648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 180/377] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:52.171533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:52.172291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:52.185303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.186125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:52.187104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.187544 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:52.211087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:52.240871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:52.253457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-30303fc5-c89e-4372-bcca-394307fe07d9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.464591 Jul 29 12:52:52.264340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 198/378] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:51 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:52.379910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:52.391702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d6d65898-79ac-42be-8ebe-e9b39fc9b099 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.226557 Jul 29 12:52:52.392444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 181/379] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:52 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:52.471499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:52.472670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:52.481769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.482249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:52.483057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.484251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:52.735321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-ea3408d2-a529-4dcb-8015-72744b000784 req-08cc1ad6-addb-4415-9bc6-963e33b1e1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a714f7-cb41-49d2-a3d9-548b76a88ff0", "name": "network-vif-plugged", "status": "completed", "tag": "554bff31-bbb8-4e37-b051-7ae3996fa046"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:52.755533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ea3408d2-a529-4dcb-8015-72744b000784 req-08cc1ad6-addb-4415-9bc6-963e33b1e1ff service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.755993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ea3408d2-a529-4dcb-8015-72744b000784 req-08cc1ad6-addb-4415-9bc6-963e33b1e1ff service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:52.756129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:52.772850 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:52.782279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-ea3408d2-a529-4dcb-8015-72744b000784 req-08cc1ad6-addb-4415-9bc6-963e33b1e1ff service nova] Creating event network-vif-plugged:554bff31-bbb8-4e37-b051-7ae3996fa046 for instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 on hv-cinder-81914 Jul 29 12:52:52.785127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:52.787583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dded5ce3-299a-45df-b071-33aaa94c1999 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.324237 Jul 29 12:52:52.789620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-ea3408d2-a529-4dcb-8015-72744b000784 req-08cc1ad6-addb-4415-9bc6-963e33b1e1ff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061877 Jul 29 12:52:52.790745 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 182/380] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:52.792644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 199/381] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:52 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:52.840420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:52.841647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:52.855902 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.856622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:52.858873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:52.861704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:53.029461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:53.047857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6cb995ad-014b-49cb-aa78-5614deffa38f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.212755 Jul 29 12:52:53.048340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 183/382] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:52 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:53.281165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:53.284122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:53.303638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:53.306335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:53.308867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:53.310589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:53.412911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:53.413893 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:53.423886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:53.424468 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:53.425964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:53.426520 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:53.541359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:53.552871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-002f6776-7655-4e15-9d43-ef93c1f032cb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.278092 Jul 29 12:52:53.559335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 200/383] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:53 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:53.717039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:53.729957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ff3b2f77-ddaf-44d2-bde4-a76ff714c82a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.321075 Jul 29 12:52:53.731202 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 184/384] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:53 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:53.815815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:53.816822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:53.824958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:53.825953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:53.827878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:53.828813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.071650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:54.072469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:54.099849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:54.100343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.101303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:54.103605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.106954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:54.144419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:54.147521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:54.154169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4a672434-2122-474f-9eab-d05a25ab69cc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.341124 Jul 29 12:52:54.190526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 201/385] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:53 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:54.579989 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:54.581441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:54.591817 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:54.592691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.593889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:54.594561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.612741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:54.621215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3f7e0dba-3631-4f88-99b4-58d61ef31cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.554326 Jul 29 12:52:54.632603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 185/386] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:54 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:54.752920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:54.753873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:54.775272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:54.776035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.778076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:54.781364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:54.796356 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:54.806167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-09780305-cd3c-4158-b565-7c38aa15637b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.229186 Jul 29 12:52:54.823064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 202/387] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:54 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:55.169085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:55.182776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:55.183665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:55.199833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:55.202983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-46c6be61-fb74-4174-ae23-c9a22d033418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.454976 Jul 29 12:52:55.203644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:55.205263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:55.205888 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:55.207632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 186/388] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:54 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:55.471788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:55.485848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:55.487638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:55.490127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f23d5c00-07e0-4bc0-9cce-0b372df0c083 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.311697 Jul 29 12:52:55.519225 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 203/389] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:55 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:55.650714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:55.651521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:55.661142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:55.662095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:55.663121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:55.663778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:55.831053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:55.831724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:55.839349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:55.839719 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:55.840732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:55.841183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:55.870736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:56.052494 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:56.088104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dd46ddd9-340d-4c27-9a85-f2d419322b7e tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1370 microversion: 2.1 time: 0.261081 Jul 29 12:52:56.106347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 204/390] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:55 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:56.229610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:56.230583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:56.232873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=20 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:56.241452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:56.242569 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:56.243360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:56.243807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:56.410054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:56.419629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c4ea89b8-2f9f-4015-9566-3556fa785a36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.772854 Jul 29 12:52:56.444088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 187/391] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:55 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:56.481317 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:56.497229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bb8f3ff2-21aa-4747-a97b-7a8771ba5e65 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.269055 Jul 29 12:52:56.505851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 205/392] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:56 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:56.526196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:56.527017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:56.547410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:56.551281 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:56.552403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:56.557666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:56.894656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:56.916234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:56.920979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:56.928785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f7c0e3ad-1047-4d26-a4ff-15a908caefbd tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.407333 Jul 29 12:52:56.934582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 188/393] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:56 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:57.114732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:57.116391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:57.132508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.136936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.138025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.141225 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.316566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:57.327038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49607550-f8fe-4a09-be93-922ce2fd8665 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1564 microversion: 2.1 time: 0.216000 Jul 29 12:52:57.328449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 206/394] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:57 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1564 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:52:57.368945 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:57.370325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:57.387652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.389565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.390620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.391520 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.467532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:57.468221 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:57.475782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.476358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.477150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.477643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.584430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-607a189e-b96d-46ba-a8ff-4f40976e9b4a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220156 Jul 29 12:52:57.586784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 189/395] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:52:57 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:52:57.603619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:57.604692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:57.624573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.625294 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.626438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.627030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.653959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:57.662940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9b6b5515-e96b-43a1-826b-c7e14d175d1d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.201744 Jul 29 12:52:57.664820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 207/396] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:57 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:57.976979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:57.977671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:57.983862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:57.986337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.986954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:57.988054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:57.988765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:58.007888 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:58.019102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:52:58.021722 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ee907508-ef78-43dd-af1b-cf3a7ec46378 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.433716 Jul 29 12:52:58.022437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 190/397] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:57 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:58.174028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:58.184180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:58.185845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:58.187013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-787c5399-2a7d-4f10-a08f-35b0598daaa4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1737 microversion: 2.20 time: 0.214813 Jul 29 12:52:58.187571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 208/398] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:57 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:58.685748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:58.687625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:58.694530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:58.695216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:58.696302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:58.696910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.045583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:59.046232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:59.053176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:59.053627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.054449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:59.054888 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.270342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:59.278679 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-91385365-5501-4368-bf1f-52002b7a580c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.597600 Jul 29 12:52:59.292579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 191/399] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:58 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:59.292579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:52:59.292579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:52:59.292579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:59.293061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.293323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:59.294050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.429157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:59.442592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6898cdce-7b20-4297-8e84-cd6563908d7d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.402779 Jul 29 12:52:59.443727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 209/400] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:52:59 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:52:59.711086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:59.714967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-850a40ed-d13a-4d43-b14a-7dd51fb94e4b req-971b90f8-d115-4a70-8ec8-7870c8e58fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1159bd7-b7c9-4745-b0c5-9c5207d8291d", "name": "network-vif-plugged", "status": "completed", "tag": "3cabe18f-cd87-4cae-b162-144c5306bea8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:59.722355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:59.725634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:52:59.727270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2db1c1aa-d710-43ac-a620-af61b3f6a730 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1719 microversion: 2.20 time: 0.446488 Jul 29 12:52:59.728430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 192/401] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:52:59 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1719 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:52:59.731557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-850a40ed-d13a-4d43-b14a-7dd51fb94e4b req-971b90f8-d115-4a70-8ec8-7870c8e58fa4 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:59.733896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-850a40ed-d13a-4d43-b14a-7dd51fb94e4b req-971b90f8-d115-4a70-8ec8-7870c8e58fa4 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.761757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-850a40ed-d13a-4d43-b14a-7dd51fb94e4b req-971b90f8-d115-4a70-8ec8-7870c8e58fa4 service nova] Creating event network-vif-plugged:3cabe18f-cd87-4cae-b162-144c5306bea8 for instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d on hv-cinder-81914 Jul 29 12:52:59.773536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-850a40ed-d13a-4d43-b14a-7dd51fb94e4b req-971b90f8-d115-4a70-8ec8-7870c8e58fa4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065537 Jul 29 12:52:59.777588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 210/402] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:52:59.849088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-9209dd0c-9850-460f-8258-104b9491dd6d req-4cb1280c-6194-4d86-9e73-0770392b53ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a714f7-cb41-49d2-a3d9-548b76a88ff0", "tag": "554bff31-bbb8-4e37-b051-7ae3996fa046"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:52:59.870303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-9209dd0c-9850-460f-8258-104b9491dd6d req-4cb1280c-6194-4d86-9e73-0770392b53ae service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:52:59.871640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-9209dd0c-9850-460f-8258-104b9491dd6d req-4cb1280c-6194-4d86-9e73-0770392b53ae service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:52:59.900126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-9209dd0c-9850-460f-8258-104b9491dd6d req-4cb1280c-6194-4d86-9e73-0770392b53ae service nova] Creating event network-changed:554bff31-bbb8-4e37-b051-7ae3996fa046 for instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 on hv-cinder-81914 Jul 29 12:52:59.913524 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-9209dd0c-9850-460f-8258-104b9491dd6d req-4cb1280c-6194-4d86-9e73-0770392b53ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068879 Jul 29 12:52:59.916666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 193/403] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:00.320053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:00.320998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:00.331409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:00.332050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:00.333226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:00.333618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:00.465424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:00.466935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:00.482849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:00.483604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:00.484630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:00.485285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:00.560379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:00.570443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9fe754c8-ed23-4286-bcef-b49159a46533 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.272289 Jul 29 12:53:00.571328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 211/404] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:00 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:00.754675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:00.755404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:00.763024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:00.763748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:00.764931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:00.765571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:00.808710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:00.831884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-709d27eb-826a-4e0c-b016-a4710679a1f5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.372030 Jul 29 12:53:00.832501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 194/405] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:00 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:00.971293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:00.982335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:00.984701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:00.985968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fc04c107-fc0a-4f39-96eb-55f5e3ee77a0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1719 microversion: 2.20 time: 0.235432 Jul 29 12:53:00.986527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 212/406] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:00 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:01.594370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:01.595606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:01.604969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:01.605944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:01.607786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:01.608686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:01.830340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:01.840119 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-08375ec9-0168-40cb-9a2f-be997f1207a9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.249877 Jul 29 12:53:01.841452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 195/407] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:01 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:01.866450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:01.867287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:01.875535 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:01.876029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:01.876864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:01.877972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:02.009351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:02.010162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:02.018553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:02.019147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:02.022413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:02.022946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:02.228006 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:02.237126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:02.238665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:02.240129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cb9e7127-a3c5-4d82-ada8-9e16fc52a438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1719 microversion: 2.20 time: 0.234828 Jul 29 12:53:02.240850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 196/408] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:02 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:02.410644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:02.422439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4893980d-1946-4040-b8bf-1d4f68422aac tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.565876 Jul 29 12:53:02.423652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 213/409] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:01 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:02.866497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:02.867799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:02.882556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:02.883268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:02.885640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:02.886303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:03.158816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:03.166698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2883e7e8-3191-4960-a9af-2f7fa70ca2d9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.304723 Jul 29 12:53:03.167585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 197/410] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:02 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:03.267737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:03.268753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:03.279818 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:03.280421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:03.282463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:03.283111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:03.443779 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:03.444667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:03.452063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:03.452824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:03.453797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:03.454518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:03.621903 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:03.638553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:03.640842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:03.642677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d33e6479-1041-4042-aa1d-662d1fbb0cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1722 microversion: 2.20 time: 0.381484 Jul 29 12:53:03.656027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:03.658362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 214/411] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:03 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:03.672581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-03d8be6a-1289-4baa-b0a6-b24125a0e1aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1366 microversion: 2.1 time: 0.232445 Jul 29 12:53:03.672796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "684e63d4-86a8-4b05-a8c3-76df28567571"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:03.673192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 198/412] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:03 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:03.677319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:03.685844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:03.686383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:03.687162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:03.687595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.050368 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-93221cab-526f-4c3e-a512-9bbd14ff75e2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.385945 Jul 29 12:53:04.050985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 215/413] 10.222.0.66 () {62 vars in 1364 bytes} [Fri Jul 29 12:53:03 2022] POST /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments => generated 188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 12:53:04.197637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:04.197637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:04.207078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:04.207723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:04.215402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.220043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.225337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.225974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.228236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.228898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.231709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.232375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.334876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129324) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 12:53:04.472456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-82cdade3-e598-47f5-8538-32886a2ced9b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/action" status: 202 len: 0 microversion: 2.20 time: 0.270405 Jul 29 12:53:04.476261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 216/414] 10.222.0.66 () {62 vars in 1319 bytes} [Fri Jul 29 12:53:04 2022] POST /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 12:53:04.481609 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-c6ffe20a-3c24-4567-a220-71d904012982 req-0480f155-f22b-4aa9-b1fc-6da9b5c5dc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "name": "network-vif-unplugged", "status": "completed", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:04.493316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-c6ffe20a-3c24-4567-a220-71d904012982 req-0480f155-f22b-4aa9-b1fc-6da9b5c5dc0c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.493762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-c6ffe20a-3c24-4567-a220-71d904012982 req-0480f155-f22b-4aa9-b1fc-6da9b5c5dc0c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.506720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.compute.server_external_events [req-c6ffe20a-3c24-4567-a220-71d904012982 req-0480f155-f22b-4aa9-b1fc-6da9b5c5dc0c service nova] Unable to find a host for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb. Dropping event network-vif-unplugged {{(pid=129324) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 12:53:04.507622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-c6ffe20a-3c24-4567-a220-71d904012982 req-0480f155-f22b-4aa9-b1fc-6da9b5c5dc0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033149 Jul 29 12:53:04.508235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 217/415] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 29 12:53:04.513633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:04.514280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:04.521790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.522503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.523565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.524411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.684411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:04.688810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:04.717955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-88d0ec52-0cd9-46ca-b6d5-95051420c418 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.533849 Jul 29 12:53:04.724371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 199/416] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:04 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:04.737107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:04.739718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:04.754332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.757909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.758828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:04.761148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:04.804839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:04.814292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:04.818029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:04.826390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-835ad41c-4721-4301-95da-41bf20b12c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1748 microversion: 2.20 time: 0.312983 Jul 29 12:53:04.827362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 218/417] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:04 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1748 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:05.449543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:05.459268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d3189e11-6f14-45d4-b1b7-2abaa6d178da tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1556 microversion: 2.1 time: 0.731830 Jul 29 12:53:05.460586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 200/418] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:04 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1556 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:05.482583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:05.483818 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:05.497588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:05.498066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:05.499710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:05.500144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:05.647695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e10bd6d1-cb55-402b-9c6f-ebc9b8dcf6aa tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170449 Jul 29 12:53:05.648853 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 219/419] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:53:05 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:05.742978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:05.744700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:05.755669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:05.756385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:05.757354 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:05.761882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:05.858999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:05.859547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:05.872014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:05.872463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:05.878789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:05.879534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:06.290259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:06.300072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:06.301584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:06.313411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6b90b204-86ad-4f35-a58e-9c1b973470d2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1748 microversion: 2.20 time: 0.463155 Jul 29 12:53:06.314040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 220/420] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:05 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1748 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:06.400922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:06.413391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e8f8a7d0-f37f-4f4c-80df-c775df8a1b65 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.674144 Jul 29 12:53:06.418892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 201/421] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:05 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:06.559526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-064134d9-853e-469d-a2b8-025c8f748e61 req-0f5ebc41-776b-4229-bce2-3aaa561dcd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e77e87a-7f63-4eb0-9357-1e907bb5cf68", "name": "network-vif-plugged", "status": "completed", "tag": "832e8a04-76aa-4ddd-a3f4-44fbaa7755b3"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:06.586305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-064134d9-853e-469d-a2b8-025c8f748e61 req-0f5ebc41-776b-4229-bce2-3aaa561dcd72 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:06.587804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-064134d9-853e-469d-a2b8-025c8f748e61 req-0f5ebc41-776b-4229-bce2-3aaa561dcd72 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:06.606366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-064134d9-853e-469d-a2b8-025c8f748e61 req-0f5ebc41-776b-4229-bce2-3aaa561dcd72 service nova] Creating event network-vif-plugged:832e8a04-76aa-4ddd-a3f4-44fbaa7755b3 for instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 on hv-cinder-81914 Jul 29 12:53:06.612944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-064134d9-853e-469d-a2b8-025c8f748e61 req-0f5ebc41-776b-4229-bce2-3aaa561dcd72 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061967 Jul 29 12:53:06.614452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 221/422] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:07.209367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:07.218570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:07.230112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.231635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.232938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.233542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.276441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a883a738-1572-4cc6-89f8-274139943c70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/ips" status: 200 len: 145 microversion: 2.1 time: 0.074077 Jul 29 12:53:07.286833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 202/423] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:53:07 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:07.337037 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:07.337731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:07.347873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.348330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.349103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.349542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.449151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:07.450256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:07.463293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.465219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.468295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.470694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.623625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:07.641978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:07.647017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:07.651737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a7a3670b-1761-446e-a1b1-7bf53bd22db8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1750 microversion: 2.20 time: 0.318753 Jul 29 12:53:07.653931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 222/424] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:07 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1750 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:07.668170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-2572723a-9c53-42de-b2df-841f3cf76d53 req-b3115819-7d90-40ed-98aa-c756b4d26770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1159bd7-b7c9-4745-b0c5-9c5207d8291d", "tag": "3cabe18f-cd87-4cae-b162-144c5306bea8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:07.698195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-2572723a-9c53-42de-b2df-841f3cf76d53 req-b3115819-7d90-40ed-98aa-c756b4d26770 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:07.698999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-2572723a-9c53-42de-b2df-841f3cf76d53 req-b3115819-7d90-40ed-98aa-c756b4d26770 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:07.713423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-2572723a-9c53-42de-b2df-841f3cf76d53 req-b3115819-7d90-40ed-98aa-c756b4d26770 service nova] Creating event network-changed:3cabe18f-cd87-4cae-b162-144c5306bea8 for instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d on hv-cinder-81914 Jul 29 12:53:07.730559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-2572723a-9c53-42de-b2df-841f3cf76d53 req-b3115819-7d90-40ed-98aa-c756b4d26770 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074953 Jul 29 12:53:07.731491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 223/425] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:07.831553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:07.846797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b7a5b417-8e91-454d-b36e-e3d46031da7f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1264 microversion: 2.1 time: 0.411559 Jul 29 12:53:07.869630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 203/426] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:07 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1264 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:08.690808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:08.691541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:08.698805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:08.699179 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:08.700177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:08.700612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:08.737275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:08.882314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:08.884395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:08.895818 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:08.896574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:08.897557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:08.898187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:08.967894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:08.982445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:08.984283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:08.985642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-197459ff-2834-40a1-98c7-eb259c340c95 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.306346 Jul 29 12:53:09.002559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 224/427] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:08 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:09.207329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:09.237894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d785c8eb-27a3-4e17-a66c-597e99bb5044 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1451 microversion: 2.1 time: 0.356017 Jul 29 12:53:09.239376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 204/428] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:08 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1451 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:09.264259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:09.265311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:09.277725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:09.279371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:09.281313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:09.282059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:09.664414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:09.673235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8881da77-18e3-4bcb-b082-de40908453d2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1451 microversion: 2.1 time: 0.414154 Jul 29 12:53:09.678396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 225/429] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:09 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1451 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:10.011448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:10.013122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:10.027221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:10.027943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:10.028883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:10.029533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:10.278281 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:10.288649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:10.290559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:10.292150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2a4745d2-a75e-459c-8f74-152ef614e82a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.285526 Jul 29 12:53:10.306406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 205/430] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:10 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:10.701074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c4eda24-95b4-49fd-aa10-38c357ded5cf"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:10.703698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:10.712041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:10.712870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:10.714012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:10.714906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:11.302865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3c507768-682e-4d47-923e-fb5180a4ec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606935 Jul 29 12:53:11.304376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 226/431] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:53:10 2022] POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:11.316417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:11.317020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:11.335909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:11.336444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:11.337455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:11.338165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:11.626177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:11.640328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:11.648183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:11.669143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1f224c75-9d42-4002-a5f8-eab08ab6aec0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.356487 Jul 29 12:53:11.670061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 206/432] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:11 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:12.696090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:12.697631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:12.714802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:12.717573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:12.721702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:12.723290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:13.098750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-f7e382fc-7569-46fc-b607-981d914348a3 req-fb5d6c11-9de1-4536-b0ab-5fafb394b31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e77e87a-7f63-4eb0-9357-1e907bb5cf68", "tag": "832e8a04-76aa-4ddd-a3f4-44fbaa7755b3"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:13.125158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-f7e382fc-7569-46fc-b607-981d914348a3 req-fb5d6c11-9de1-4536-b0ab-5fafb394b31e service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:13.131214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-f7e382fc-7569-46fc-b607-981d914348a3 req-fb5d6c11-9de1-4536-b0ab-5fafb394b31e service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:13.173491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-f7e382fc-7569-46fc-b607-981d914348a3 req-fb5d6c11-9de1-4536-b0ab-5fafb394b31e service nova] Creating event network-changed:832e8a04-76aa-4ddd-a3f4-44fbaa7755b3 for instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 on hv-cinder-81914 Jul 29 12:53:13.197380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-f7e382fc-7569-46fc-b607-981d914348a3 req-fb5d6c11-9de1-4536-b0ab-5fafb394b31e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102622 Jul 29 12:53:13.198270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 207/433] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:53:13.241624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:13.252672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:13.254322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:13.255638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-48cd1127-8c1f-438b-a295-f83eb01f23c0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.566668 Jul 29 12:53:13.265332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 227/434] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:12 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:14.296541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:14.297085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:14.335490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:14.335945 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:14.336733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:14.337173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:14.558264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:14.569744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:14.571525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:14.572933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4317b9eb-ae14-4d90-94c0-7e5119438586 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.281676 Jul 29 12:53:14.600483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 208/435] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:14 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:15.600301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:15.601100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:15.618084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:15.619017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:15.620065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:15.620655 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:15.903451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:15.913704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:15.916673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:15.918062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-befe8bcd-b317-4da9-af3a-2ad386c04c0e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.322018 Jul 29 12:53:15.919140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 228/436] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:15 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:16.946225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:16.946878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:16.959005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:16.963897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:16.966611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:16.969630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:17.242260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:17.252304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:17.254223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:17.255614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-940d6370-04eb-4c7a-9210-dd52b4477000 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.313468 Jul 29 12:53:17.256649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 209/437] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:16 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:18.289909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:18.290717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:18.307967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:18.310007 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:18.311221 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:18.312831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:18.605205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:18.615966 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:18.619743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:18.621307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3f615be9-9b1a-43d7-9743-96c5afbeb9b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.338234 Jul 29 12:53:18.622418 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 229/438] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:18 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:19.648572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:19.649213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:19.652877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=72 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:19.662911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:19.663364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:19.664144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:19.664584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:19.890015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:19.900831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:19.902263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:19.903426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a8ea715f-2e24-40a9-8aec-ea70c84aab4f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.258756 Jul 29 12:53:19.904463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 210/439] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:19 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:20.463580 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9b51fe14-fe67-4dad-9ea8-ec34a9132d5b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Action: 'create', calling method: .version_select at 0x7f74a2126b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1206041811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVS3huoFFC9dNTo1BhwRbjupl2zIWVDJM5Hs66DsiTjtcZ8hYfAIBFg9GtnSsNUx+BJ2iwroSRPSZnzCDw64GDD0ao609l92v88bx425WJTQp9hpQ+n1JqTPZq1czYJQA=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:20.483334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-9b51fe14-fe67-4dad-9ea8-ec34a9132d5b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Getting quotas for project 3686c63736c7409eb7cc4170607ca6fb. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:53:20.487735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-9b51fe14-fe67-4dad-9ea8-ec34a9132d5b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Getting quotas for user 9a73d627ff2b4826b3ab025f5eea27f6 and project 3686c63736c7409eb7cc4170607ca6fb. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:53:20.516285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9b51fe14-fe67-4dad-9ea8-ec34a9132d5b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057144 Jul 29 12:53:20.516902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 230/440] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:53:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:53:20.633996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-262798068", "imageRef": "064851e5-544a-4eab-93dc-4cdcfb373797", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1206041811", "networks": [{"uuid": "3e86e0d8-605e-4458-9bee-9462a42ba5c7"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:20.698611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] validate_networks() for [('3e86e0d8-605e-4458-9bee-9462a42ba5c7', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:53:20.930913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:20.931973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:20.938375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:20.939364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:20.939989 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:20.940454 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:21.093056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:53:21.093729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:53:21.094361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:53:21.094869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:53:21.095705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:53:21.099029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:21.110731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:21.111556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:21.112889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:21.113564 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:21.122700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:21.124459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:21.125776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c5fc7c07-6376-4ccd-b210-9f0826c1c01f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.199125 Jul 29 12:53:21.126622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 231/441] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:20 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:21.138127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Getting quotas for project 3686c63736c7409eb7cc4170607ca6fb. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:53:21.142414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Getting quotas for user 9a73d627ff2b4826b3ab025f5eea27f6 and project 3686c63736c7409eb7cc4170607ca6fb. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:53:21.154120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:53:21.156315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='064851e5-544a-4eab-93dc-4cdcfb373797',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:53:21.209119 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-94c4f648-999e-42de-a1bf-fd26c288a2a4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578810 Jul 29 12:53:21.216049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 211/442] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:53:21.221548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d03c35bb-ec38-4d5c-8ca7-c05560ffa53c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:21.222237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d03c35bb-ec38-4d5c-8ca7-c05560ffa53c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:21.296971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d03c35bb-ec38-4d5c-8ca7-c05560ffa53c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:21.304118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d03c35bb-ec38-4d5c-8ca7-c05560ffa53c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1258 microversion: 2.1 time: 0.086710 Jul 29 12:53:21.304926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 232/443] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:21 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:22.149764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:22.150972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:22.159967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:22.160712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:22.161860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:22.162525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:22.313441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:22.325899 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:22.327249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:22.327811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:22.328582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-417fc518-9019-4de5-bf62-0fba6f7e817f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.183412 Jul 29 12:53:22.328715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:22.329312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 212/444] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:22 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:22.336355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:22.337088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:22.338162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:22.338835 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:22.404838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:22.412460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-73cd6cf1-4203-40c9-9698-268cff31a963 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1262 microversion: 2.1 time: 0.090436 Jul 29 12:53:22.413031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 233/445] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:22 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:23.351416 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:23.367178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:23.367178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:23.367178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:23.367178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:23.367770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:23.434906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:23.436244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:23.456880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:23.461727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:23.463320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:23.469096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:23.553967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:23.563819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d7331ae0-92ad-423a-930c-d5bb35a82683 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1262 microversion: 2.1 time: 0.134481 Jul 29 12:53:23.565134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 234/446] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:23 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1262 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:23.595395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:23.606143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:23.608527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:23.610926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7b2722a0-cc34-459f-8f43-3c6eb9c87ec5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.262198 Jul 29 12:53:23.610926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 213/447] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:23 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:24.584475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:24.585099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:24.605521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:24.607406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:24.608243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:24.608684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:24.640602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:24.641308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:24.648194 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:24.648867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:24.649726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:24.650787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:24.683832 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:24.691910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-07e26c74-9d56-4627-b014-051352245c59 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1262 microversion: 2.1 time: 0.111135 Jul 29 12:53:24.692828 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 235/448] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:24 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1262 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:24.802541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:24.813305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:24.814849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:24.816027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-049da511-ba14-4b93-90c1-caee38c4677f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.181695 Jul 29 12:53:24.816587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 214/449] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:24 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:25.714133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:25.714774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:25.721461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:25.721952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:25.722714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:25.723147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:25.785367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:25.792712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f39a3199-7446-442c-99ce-70afb08e154c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1262 microversion: 2.1 time: 0.083076 Jul 29 12:53:25.793294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 236/450] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:25 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:25.839695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:25.840244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:25.847258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:25.847713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:25.848487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:25.848932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:25.979384 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:25.987747 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:25.989254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:25.990441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7dd4ebd2-3479-4df4-a60a-5dcd2b8eacce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.154688 Jul 29 12:53:25.991002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 215/451] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:25 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:26.813349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:26.814134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:26.821605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:26.822115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:26.822959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:26.823387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:26.907971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:26.930153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fa11b7fc-6cee-4956-9250-f9ad521cbdb4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1254 microversion: 2.1 time: 0.121130 Jul 29 12:53:26.932989 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 237/452] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:26 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1254 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:27.019267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:27.019890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:27.026664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:27.027155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:27.028116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:27.028757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:27.174555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:27.184701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:27.186371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:27.187704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-781138fb-73c6-487e-a695-99645a635de0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.173127 Jul 29 12:53:27.189864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 216/453] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:27 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:27.943507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e56a3a84-a6b8-4b94-9273-406a6f8a11f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:27.950963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e56a3a84-a6b8-4b94-9273-406a6f8a11f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:27.951413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e56a3a84-a6b8-4b94-9273-406a6f8a11f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:27.953214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:27.953859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:27.959805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:27.960256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:27.961020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:27.961464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:28.012561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e56a3a84-a6b8-4b94-9273-406a6f8a11f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Going to try to stop instance {{(pid=129324) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 12:53:28.022640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:28.032181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6b920009-6a65-4adf-b52e-e16faab88613 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1328 microversion: 2.1 time: 0.081750 Jul 29 12:53:28.033317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 217/454] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:27 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1328 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:28.061122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e56a3a84-a6b8-4b94-9273-406a6f8a11f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action" status: 202 len: 0 microversion: 2.1 time: 0.121130 Jul 29 12:53:28.066537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 238/455] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:53:27 2022] POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:53:28.072820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:28.073654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:28.079987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:28.080644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:28.081607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:28.082229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:28.086846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:28.212113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:28.213575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:28.219446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:28.222909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:28.223876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:28.224898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:28.225565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:28.244071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:28.252149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b239925e-18ee-4301-a2c0-f8757caa06e9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.184979 Jul 29 12:53:28.252915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 218/456] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:28 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:28.427266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:28.435754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:28.437274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:28.438461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2633e71e-dd42-43fc-bcb9-9dd963cda1c9 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.230955 Jul 29 12:53:28.439023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 239/457] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:28 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:29.056637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:29.057239 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:29.069570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.070333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:29.074804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.075260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:29.273290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:29.275039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:29.283728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.284471 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:29.285707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.286325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:29.301804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:29.314086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-104df839-bfb5-426f-ae2e-7da30ebf1af8 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.262731 Jul 29 12:53:29.314660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 219/458] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:29 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:29.462930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:29.463602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:29.470104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.470642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:29.471762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.472277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:29.532141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:29.558191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:29.561900 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-640eeaab-4810-467e-973f-16b274afc20b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.293026 Jul 29 12:53:29.566584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 240/459] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:29 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:29.662542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:29.677564 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:29.680256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:29.682414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cfddca87-713f-476f-bd7d-7ebd56a36801 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.223721 Jul 29 12:53:29.683498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 220/460] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:29 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:29.969218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-26476b20-7bfc-4451-a792-22ee35e9db5f req-a4cd6798-edf8-43a2-8f69-7c2c07053d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:29.992381 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-26476b20-7bfc-4451-a792-22ee35e9db5f req-a4cd6798-edf8-43a2-8f69-7c2c07053d58 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:29.994961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-26476b20-7bfc-4451-a792-22ee35e9db5f req-a4cd6798-edf8-43a2-8f69-7c2c07053d58 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.033450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-26476b20-7bfc-4451-a792-22ee35e9db5f req-a4cd6798-edf8-43a2-8f69-7c2c07053d58 service nova] Creating event network-changed:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:53:30.041899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-26476b20-7bfc-4451-a792-22ee35e9db5f req-a4cd6798-edf8-43a2-8f69-7c2c07053d58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093116 Jul 29 12:53:30.046576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 241/461] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:30.335662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:30.336294 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:30.342901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:30.343347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.344107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:30.344542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.476731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:30.484815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dfe6d1f4-4130-45f4-b809-44821987f745 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.152975 Jul 29 12:53:30.485430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 221/462] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:30 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:30.587795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:30.588483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:30.594814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:30.595265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.596537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:30.597390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.707521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:30.708276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:30.721687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:30.722197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.722997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:30.723439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:30.747003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:30.755589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dcb53097-550e-46f6-a8e6-efca76da8411 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.172447 Jul 29 12:53:30.769812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 242/463] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:30 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:30.878516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:30.888348 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:30.890317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:30.891702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a1a305a0-3b6e-457b-84ff-3ff07b5f7a4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.188027 Jul 29 12:53:30.892390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 222/464] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:30 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:31.506416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:31.507093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:31.509262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=6 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:31.515082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:31.515532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:31.516305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:31.516740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:31.659453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:31.667547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cc501362-e807-46fb-97ff-85656c5cf52c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.165404 Jul 29 12:53:31.668341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 243/465] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:31 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:31.777459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:31.778252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:31.779986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:31.780782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:31.787103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:31.787565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:31.788385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:31.788894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:31.914739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:31.916061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:31.922968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:31.923460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:31.924216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:31.924650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:31.926246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:31.934565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cccd8492-60aa-496a-9e37-b9c8699088d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.161251 Jul 29 12:53:31.935334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 223/466] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:31 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:32.087526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:32.097529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:32.099079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:32.100401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-928ced93-b682-45de-9eba-ee1e7ef888e6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.189514 Jul 29 12:53:32.114022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 244/467] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:31 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:32.688380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:32.688994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:32.695211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:32.695668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:32.696440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:32.697065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:32.834710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:32.843874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2d8f5ec1-c76d-4dd6-ac7a-86572f76f81d tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.159214 Jul 29 12:53:32.847052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 224/468] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:32 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:32.956645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:32.957324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:32.964180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:32.964628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:32.965392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:32.965853 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:33.102169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:33.111040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-eb6254c9-c3e0-4f86-9dc6-600eb354b72e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.158770 Jul 29 12:53:33.111808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 245/469] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:32 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:33.128377 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:33.129042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:33.135497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:33.135941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:33.136712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:33.137159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:33.272228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:33.281075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:33.282610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:33.283766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-33e1ae2f-1b88-4c40-a9dd-e8671d2c0f3d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.159706 Jul 29 12:53:33.289112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 225/470] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:33 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:33.868894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:33.868894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:33.888594 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:33.889182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:33.890272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:33.890845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:34.034192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:34.042473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-559f4104-9040-4272-bbec-473f46a01e5c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.180304 Jul 29 12:53:34.043057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 246/471] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:33 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:34.132681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:34.133294 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:34.140004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:34.140455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:34.141357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:34.141863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:34.289627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:34.300267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3ce03d17-ded1-47e8-b7d6-0ac3c7e8f970 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.171349 Jul 29 12:53:34.301019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 226/472] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:34 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:34.308049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:34.308655 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:34.314762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:34.315218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:34.315984 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:34.316419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:34.454343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:34.462962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:34.464520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:34.465691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-10821c7d-189a-4fbc-b02a-a98a77ddcbdf tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.161543 Jul 29 12:53:34.466307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 247/473] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:34 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:35.063819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:35.064434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:35.070957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:35.071485 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:35.072267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:35.072732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:35.207716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:35.216050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2a7e45e6-fc2d-4206-8c8f-9a0061105687 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.156054 Jul 29 12:53:35.216827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 227/474] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:35 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:35.320749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:35.321919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:35.329524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:35.330305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:35.331282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:35.331794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:35.469467 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:35.478613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e5da4d37-062a-4826-bb8e-8483989048b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.161831 Jul 29 12:53:35.479200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 248/475] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:35 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:35.490392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:35.491379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:35.498544 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:35.499024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:35.499867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:35.500310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:35.642638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:35.652023 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:35.653599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:35.654824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8cccf774-8521-456a-bb05-962c68313f19 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.169026 Jul 29 12:53:35.655395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 228/476] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:35 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:36.243873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:36.244599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:36.250996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:36.251932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:36.252632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:36.252723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:36.392311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:36.401290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d8e9411a-f0de-4fc5-8ba5-c1e46cbd4304 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.161246 Jul 29 12:53:36.402290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 249/477] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:36 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:36.500506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:36.501112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:36.508232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:36.508678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:36.510113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:36.510556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:36.646642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:36.655458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-af3bcfd3-5aaf-4c62-bf53-5e6ea4fbd2a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.158844 Jul 29 12:53:36.656360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 229/478] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:36 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:36.679533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:36.680136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:36.687105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:36.687653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:36.688379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:36.688818 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:36.825423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:36.834665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:36.836214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:36.838021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ef9a537e-85df-4b6e-9d6a-1a6290b0efc5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.162365 Jul 29 12:53:36.838798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 250/479] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:36 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:37.423190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:37.423720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:37.429781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:37.430266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:37.431540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:37.431980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:37.568284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:37.575958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-62882ff9-5c94-4e39-8886-52809c30b4f3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.156671 Jul 29 12:53:37.576624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 230/480] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:37 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:37.677208 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:37.677746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:37.689848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:37.689848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:37.690585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:37.691026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:37.829397 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:37.839198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4c91dc38-ebde-4ef5-94a1-f0b8b689f8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.165811 Jul 29 12:53:37.840352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 251/481] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:37 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:37.870117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:37.871207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:37.879573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:37.880417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:37.883525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:37.883525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:38.033593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:38.043489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:38.045061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:38.046287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1afdb416-b108-4ff1-b71f-d5d4646065c6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.187336 Jul 29 12:53:38.046848 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 231/482] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:37 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:38.597029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:38.597973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:38.604465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:38.604914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:38.605685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:38.606155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:38.748736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:38.763303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7516ee01-145e-4e37-8cc2-69196382cb46 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.170532 Jul 29 12:53:38.764471 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 252/483] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:38 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:38.865673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:38.866284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:38.873200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:38.873657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:38.874496 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:38.874903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:39.011405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:39.019486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f3cf03b4-6477-432a-96f0-a95f27580561 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.157694 Jul 29 12:53:39.020056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 232/484] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:38 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:39.070996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:39.071620 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:39.077665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:39.078145 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:39.078929 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:39.079361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:39.209023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:39.217951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:39.219449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:39.220589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fc332e3e-5f90-425b-b8c0-b38197a94a9d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.153514 Jul 29 12:53:39.221443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 253/485] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:39 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:39.784871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:39.785483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:39.792082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:39.792559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:39.793320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:39.793757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:39.936579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:39.944022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3bc80647-1ffd-4143-b745-6057af2c7d26 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.163061 Jul 29 12:53:39.944582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 233/486] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:39 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:40.040901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:40.041449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:40.047934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:40.048392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:40.049159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:40.049598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:40.189325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:40.199862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3dc5fe31-15dc-4af1-9f14-66e162631e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.163400 Jul 29 12:53:40.200432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 254/487] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:40 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:40.244563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:40.245160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:40.251127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:40.251574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:40.252331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:40.252761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:40.379271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:40.382724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:40.389222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:40.390775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:40.391905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0b12d755-502b-45fb-b582-559a8f705ea4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.151272 Jul 29 12:53:40.392458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 234/488] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:40 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:40.964272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:40.964892 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:40.971304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:40.971758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:40.972528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:40.972967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:41.203436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:41.211092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-70bb78c1-f029-4d05-a486-d42320b4dfd3 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.250667 Jul 29 12:53:41.211655 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 255/489] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:40 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:41.223292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:41.224012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:41.231277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:41.231728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:41.232499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:41.232931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:41.360553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:41.368880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-590d879a-53a7-42a5-88c4-bbb4a1640dec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.149571 Jul 29 12:53:41.369453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 235/490] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:41 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:41.416082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:41.416610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:41.422613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:41.423101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:41.423858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:41.424294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:41.559121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:41.569231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:41.570774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:41.572943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-86290a69-8380-4492-9227-41464e392d99 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.160864 Jul 29 12:53:41.573654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 256/491] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:41 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:42.232573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:42.233174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:42.239784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:42.240256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:42.241007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:42.241439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:42.371820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:42.379376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d23a43e4-d76c-4fa6-b02b-0a31d9a26850 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.150554 Jul 29 12:53:42.379878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 236/492] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:42 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:42.390199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:42.390984 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:42.397793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:42.398289 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:42.399053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:42.399995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:42.531309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:42.539361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1dd6222d-b560-4ac9-af2a-32404529c263 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.153433 Jul 29 12:53:42.539969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 257/493] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:42 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:42.597128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:42.597736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:42.604343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:42.604880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:42.605639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:42.606108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:42.735169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:42.743553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:42.745153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:42.746372 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ee050157-2475-4e77-af53-f9e688756c4c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.153318 Jul 29 12:53:42.746933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 237/494] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:42 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:43.400588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:43.401136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:43.407518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:43.407962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:43.408713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:43.409142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:43.413090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:43.541528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:43.548936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d8386fce-25e7-4ab0-98a1-62cb698a83d5 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.152754 Jul 29 12:53:43.549504 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 258/495] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:43 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:43.560387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:43.561029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:43.567519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:43.567980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:43.568792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:43.569270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:43.702633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:43.710832 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-601f11a6-d838-4ec8-b248-0488ef3be0d7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.154341 Jul 29 12:53:43.711487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 238/496] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:43 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:43.771865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:43.772498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:43.778736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:43.779257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:43.780128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:43.780605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:43.920778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:43.929479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:43.931068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:43.932216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8fa245d1-45fb-4782-afcc-44414e60df01 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.164414 Jul 29 12:53:43.932769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 259/497] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:43 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:44.569050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:44.569694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:44.576884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:44.577317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:44.578182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:44.578632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:44.706368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:44.714286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fd98eab1-1575-4718-8fbe-40c1dd3d4bec tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.149132 Jul 29 12:53:44.714914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 239/498] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:44 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:44.733009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:44.733620 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:44.739683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:44.740139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:44.740908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:44.741350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:44.871862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:44.879805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2c3c2d9e-2cb5-4625-8729-cc71c0d86b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1722 microversion: 2.1 time: 0.150967 Jul 29 12:53:44.880373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 260/499] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:44 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:44.957843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:44.958463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:44.964428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:44.964881 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:44.965649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:44.966118 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:45.106852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:45.115686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:45.117452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:45.119353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f9d349b7-bdf1-4472-8320-0febb9223478 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.166296 Jul 29 12:53:45.120086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 240/500] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:44 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:45.736350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:45.736955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:45.743547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:45.744539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:45.745305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:45.745810 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:45.882369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:45.892276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-50c621b9-b213-45bd-9687-ec40a35c53af tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.159507 Jul 29 12:53:45.893026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 261/501] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:45 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:45.900291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-d8a86b8c-d92a-438d-b9bc-eb926e3ec021 req-2ffea0dd-d008-40f6-999c-dc0e3574e25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "name": "network-vif-plugged", "status": "completed", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:45.918161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:45.918780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:45.920926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d8a86b8c-d92a-438d-b9bc-eb926e3ec021 req-2ffea0dd-d008-40f6-999c-dc0e3574e25f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:45.921414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d8a86b8c-d92a-438d-b9bc-eb926e3ec021 req-2ffea0dd-d008-40f6-999c-dc0e3574e25f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:45.933391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:45.935581 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:45.936786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:45.937233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:45.944764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-d8a86b8c-d92a-438d-b9bc-eb926e3ec021 req-2ffea0dd-d008-40f6-999c-dc0e3574e25f service nova] Creating event network-vif-plugged:beb71c54-25c8-4f1d-89fb-11a56e0858a6 for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb on hv-cinder-81914 Jul 29 12:53:45.950224 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-d8a86b8c-d92a-438d-b9bc-eb926e3ec021 req-2ffea0dd-d008-40f6-999c-dc0e3574e25f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054380 Jul 29 12:53:45.950832 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 241/502] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:46.075390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:46.083473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3e27fff8-24f0-4e70-87f4-d45f73d075fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1699 microversion: 2.1 time: 0.177211 Jul 29 12:53:46.084038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 262/503] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:45 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:46.105385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-94ab16da-fc93-4011-8107-bb4574fc1663 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:46.112578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94ab16da-fc93-4011-8107-bb4574fc1663 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.113131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94ab16da-fc93-4011-8107-bb4574fc1663 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:46.142663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:46.143327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:46.149365 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.149832 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:46.150611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.151050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:46.174573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-94ab16da-fc93-4011-8107-bb4574fc1663 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Going to try to start instance {{(pid=129323) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 12:53:46.220697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-94ab16da-fc93-4011-8107-bb4574fc1663 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action" status: 202 len: 0 microversion: 2.1 time: 0.119984 Jul 29 12:53:46.221741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 242/504] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:53:46 2022] POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:53:46.230050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:46.230737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:46.237599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.238080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:46.238842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.239281 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:46.291977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:46.306302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:46.308374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:46.312393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-87bf7841-b415-4957-85ef-e91ff7281165 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.173363 Jul 29 12:53:46.313291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 263/505] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:46 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:53:46.380865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:46.389560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dd865c51-b0d1-4036-854d-b88c6a9000ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1708 microversion: 2.1 time: 0.163527 Jul 29 12:53:46.390162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 243/506] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:46 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:46.913805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:46.914677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:46.921368 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.921839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:46.922614 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:46.923050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:47.100343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:47.108308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1a579331-0409-43ca-9cbf-910b4b802174 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.198426 Jul 29 12:53:47.108933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 264/507] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:46 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:47.335977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:47.337197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:47.343761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:47.344216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:47.344976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:47.345414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:47.410805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:47.411413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:47.417415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:47.417891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:47.418658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:47.419097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:47.479161 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:47.487670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:47.489293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:47.490478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ada10276-4fac-49dc-8215-58de60766a96 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.158484 Jul 29 12:53:47.491039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 244/508] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:47 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:47.551526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:47.560533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c7c1ff2d-7864-4f68-8568-6b7aaba09a76 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1708 microversion: 2.1 time: 0.153548 Jul 29 12:53:47.561112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 265/509] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:47 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:47.965716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-e21e972f-4838-4130-a969-2303a0e6e667 req-45a5fc9a-a281-446b-9b88-f6dae6f5f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "name": "network-vif-plugged", "status": "completed", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:47.975682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-e21e972f-4838-4130-a969-2303a0e6e667 req-45a5fc9a-a281-446b-9b88-f6dae6f5f67c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:47.976132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-e21e972f-4838-4130-a969-2303a0e6e667 req-45a5fc9a-a281-446b-9b88-f6dae6f5f67c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:47.987622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-e21e972f-4838-4130-a969-2303a0e6e667 req-45a5fc9a-a281-446b-9b88-f6dae6f5f67c service nova] Creating event network-vif-plugged:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:53:47.992693 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-e21e972f-4838-4130-a969-2303a0e6e667 req-45a5fc9a-a281-446b-9b88-f6dae6f5f67c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030626 Jul 29 12:53:47.994067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 245/510] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:48.129574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:48.130213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:48.137573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:48.138054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:48.138829 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:48.139251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:48.283507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:48.291527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-eac74173-8f56-42e6-95d8-1fcf22463d07 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.165975 Jul 29 12:53:48.292097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 266/511] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:48 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:48.514905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:48.515611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:48.522372 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:48.522836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:48.523617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:48.524566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:48.582603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:48.583350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:48.591244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:48.592143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:48.592991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:48.593499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:48.667430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:48.676504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:48.678100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:48.679287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a6d58dd4-44a1-453a-a9d7-8d07c323cc66 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1806 microversion: 2.20 time: 0.169324 Jul 29 12:53:48.679905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 246/512] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:48 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:48.738262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:48.746855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aee8cd07-da75-4e56-8cc4-93aed26c8d94 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1708 microversion: 2.1 time: 0.168318 Jul 29 12:53:48.747450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 267/513] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:48 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:53:49.314228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:49.314831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:49.321582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:49.322068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:49.322837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:49.323279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:49.460903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:49.468314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-13622498-c99f-472c-b894-c9e65173d71b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.157955 Jul 29 12:53:49.468873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 247/514] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:49 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:49.703427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:49.703968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:49.710419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:49.710864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:49.711859 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:49.712025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:49.769834 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:49.770549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:49.773185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:49.781692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:49.782339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:49.783241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:49.783686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:49.861228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:49.872255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:49.875018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:49.877008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1256b9ea-e835-4c86-b25e-37c3ce99c95c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1793 microversion: 2.20 time: 0.177290 Jul 29 12:53:49.877968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 268/515] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:53:49 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1793 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:53:49.926832 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:49.935303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-36cd573e-0bd7-4033-9d9e-1f7515a5c6e7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1712 microversion: 2.1 time: 0.170740 Jul 29 12:53:49.935863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 248/516] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:49 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1712 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:50.490475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:50.491007 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:50.497118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:50.497571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:50.498366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:50.498808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:50.636324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:50.643648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3c68b50-f9f7-4cfd-bcad-70b64540517b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.157407 Jul 29 12:53:50.644208 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 269/517] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:50 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:51.665328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:51.665960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:51.672499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:51.672950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:51.673707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:51.674172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:51.806941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:51.814305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8fb680ef-20dc-4e85-8284-c798467eff42 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.153330 Jul 29 12:53:51.814873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 249/518] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:51 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:52.835393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:52.835992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:52.842843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:52.843291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:52.844039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:52.844472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:52.985563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:52.993683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7052ce81-b79a-4663-9340-d72df8ae87e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1358 microversion: 2.1 time: 0.161527 Jul 29 12:53:52.994284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 270/519] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:52 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:54.015743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:54.016392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:54.023117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.023515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.024317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.024760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.156897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:54.164270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f668a7da-4847-4c27-b2be-a1d8881a2afa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1548 microversion: 2.1 time: 0.152743 Jul 29 12:53:54.164830 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 250/520] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:54 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:54.184617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:54.185232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:54.191710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.192161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.192917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.193351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.326049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:54.333567 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3731eca-cc5e-45b1-985f-6670cc4bc71a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1548 microversion: 2.1 time: 0.153338 Jul 29 12:53:54.334186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 271/521] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:54 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:54.354043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:54.358843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:54.359614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Searching by: {'deleted': False, 'project_id': '3686c63736c7409eb7cc4170607ca6fb'} {{(pid=129323) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 12:53:54.366232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.366683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.367483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.368949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.457505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.multi_cell_list [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129323) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 12:53:54.504844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:54.556091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3855d372-1318-4b4f-8c40-6f2189aa6219 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205696 Jul 29 12:53:54.556671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 251/522] 10.222.0.66 () {58 vars in 1125 bytes} [Fri Jul 29 12:53:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:53:54.567736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:53:54.568353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:54.574931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.575386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.576150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:54.576590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:54.709170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:53:54.717281 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0ca05364-554f-4c24-bd89-e335939916e4 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1548 microversion: 2.1 time: 0.153333 Jul 29 12:53:54.718060 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 272/523] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:53:54 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:53:56.264542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "971173f7-a773-4e63-927a-8c41b75ed862"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:56.267570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:56.276488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:56.276936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:56.277689 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:56.278156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:56.537436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c257872d-e043-4b2a-a4bc-c8d6cb472c75 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277422 Jul 29 12:53:56.538070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 252/524] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:53:56 2022] POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:53:58.585951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf73bc5c-989f-4e67-ac96-cbef0d3d4a43"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:53:58.589009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:53:58.591738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=68 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:58.597639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:58.598126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:58.598897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:53:58.599337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:53:58.830336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:53:58.848261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-162c3207-4491-4f70-9a32-a47f0064560f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266237 Jul 29 12:53:58.849152 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 273/525] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:53:58 2022] POST /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:04.129719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:04.130492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:04.137295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.137736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.138561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.139001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.275562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:04.283530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e025570a-1390-4177-8822-b3c16c756a3a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1594 microversion: 2.1 time: 0.158724 Jul 29 12:54:04.284095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 253/526] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:04 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:04.428248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:04.428961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:04.435729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.436184 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.436954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.437391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.463170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1941323b-e35d-44ec-9298-f0da95302a70 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/ips" status: 200 len: 150 microversion: 2.1 time: 0.039730 Jul 29 12:54:04.463752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 274/527] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:54:04 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:04.477500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b9f5a07-50c6-4405-a319-4dc398862a87"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:04.481366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:04.483375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:04.488804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.489259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.490058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.490498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.573518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Invalid volume: volume 7b9f5a07-50c6-4405-a319-4dc398862a87 is already attached to instances: ef6fb941-1056-4618-8fd5-22dd72cf944f Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: POST /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/os-volume_attachments HTTP/1.1 Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 74 Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:54:04.575215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {"volumeAttachment": {"volumeId": "7b9f5a07-50c6-4405-a319-4dc398862a87"}} Jul 29 12:54:04.576821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Invalid volume: volume 7b9f5a07-50c6-4405-a319-4dc398862a87 is already attached to instances: ef6fb941-1056-4618-8fd5-22dd72cf944f Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'server_id': 'b1159bd7-b7c9-4745-b0c5-9c5207d8291d', 'body': {'volumeAttachment': {'volumeId': '7b9f5a07-50c6-4405-a319-4dc398862a87'}}} Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b9f5a07-50c6-4405-a319-4dc398862a87 is already attached to instances: ef6fb941-1056-4618-8fd5-22dd72cf944f Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:04.577768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b9f5a07-50c6-4405-a319-4dc398862a87 is already attached to instances: ef6fb941-1056-4618-8fd5-22dd72cf944f Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:04.579413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b9f5a07-50c6-4405-a319-4dc398862a87 is already attached to instances: ef6fb941-1056-4618-8fd5-22dd72cf944f Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 400 to user: Invalid volume: volume 7b9f5a07-50c6-4405-a319-4dc398862a87 is already attached to instances: ef6fb941-1056-4618-8fd5-22dd72cf944f {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-faba974b-0b75-4cdf-ae84-45860f0a87eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104419 Jul 29 12:54:04.581561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 254/528] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:54:04 2022] POST /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:54:04.585591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:04.586811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:04.593449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.593930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.594698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.595142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.622956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:54:04.702570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a0eab134-b17e-4513-aa20-1e5c7772ac3f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 204 len: 0 microversion: 2.1 time: 0.120407 Jul 29 12:54:04.703163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 275/529] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:54:04 2022] DELETE /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:54:04.712100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:04.713199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:04.720818 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.722010 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.723071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:04.723828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:04.881758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:04.891203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c90bd45c-9274-4e85-8f63-e8293ce162af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1681 microversion: 2.1 time: 0.183423 Jul 29 12:54:04.902926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 255/530] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:04 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:05.914688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:05.915295 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:05.922226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:05.922673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:05.923437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:05.923870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:06.140793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:06.149627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0d002f3a-d8e2-4705-8cba-530f0de4f8fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1681 microversion: 2.1 time: 0.239113 Jul 29 12:54:06.162176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 276/531] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:05 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:06.200543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-91d75f31-0eea-4952-93b0-c894ef73d3fe req-5ede9c29-843b-441e-8aa5-2eb2df7ee718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:06.211404 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-91d75f31-0eea-4952-93b0-c894ef73d3fe req-5ede9c29-843b-441e-8aa5-2eb2df7ee718 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:06.211931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-91d75f31-0eea-4952-93b0-c894ef73d3fe req-5ede9c29-843b-441e-8aa5-2eb2df7ee718 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:06.223758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-91d75f31-0eea-4952-93b0-c894ef73d3fe req-5ede9c29-843b-441e-8aa5-2eb2df7ee718 service nova] Creating event network-changed:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:54:06.229425 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-91d75f31-0eea-4952-93b0-c894ef73d3fe req-5ede9c29-843b-441e-8aa5-2eb2df7ee718 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032484 Jul 29 12:54:06.230037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 256/532] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:07.174183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-793933590"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:07.174836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:07.177065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:07.178472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:07.182830 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:07.183495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:07.184580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:07.185173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:07.186750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:07.187244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:07.188232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:07.189090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:07.328378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.network.security_group_api [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Adding security group 05c498eb-68f1-4f62-b127-338e3697cc05 to port c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 Jul 29 12:54:07.387790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:07.395934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-abf19095-c26e-4f6f-9dd1-96c206df218e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1681 microversion: 2.1 time: 0.227890 Jul 29 12:54:07.397141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 277/533] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:07 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:07.980916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0ec844e4-0dde-49ad-9b05-3e9e5d5ea5ac tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/action" status: 202 len: 0 microversion: 2.1 time: 0.811065 Jul 29 12:54:07.983241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 257/534] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:54:07 2022] POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:07.996452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-c7a42344-02f1-488b-a1cd-69c2712629bf req-b7f63db0-1783-4a79-b33d-ac5f81e3d077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:07.998972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:07.999581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:08.006009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:08.006632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:08.007574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:08.008208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:08.013685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-c7a42344-02f1-488b-a1cd-69c2712629bf req-b7f63db0-1783-4a79-b33d-ac5f81e3d077 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:08.014183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-c7a42344-02f1-488b-a1cd-69c2712629bf req-b7f63db0-1783-4a79-b33d-ac5f81e3d077 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:08.041069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-c7a42344-02f1-488b-a1cd-69c2712629bf req-b7f63db0-1783-4a79-b33d-ac5f81e3d077 service nova] Creating event network-changed:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:54:08.054280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-c7a42344-02f1-488b-a1cd-69c2712629bf req-b7f63db0-1783-4a79-b33d-ac5f81e3d077 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066477 Jul 29 12:54:08.054783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 278/535] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:08.317565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:08.326992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ea9d0797-0ed9-4027-bb3c-e0e1a60429ff tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1640 microversion: 2.1 time: 0.331843 Jul 29 12:54:08.342321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 258/536] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:07 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1640 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:08.419977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:08.420981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:08.428151 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:08.428601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:08.429378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:08.430369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:08.643724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:08.653462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-555a378c-a7bb-4a31-9999-871456991be5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1681 microversion: 2.1 time: 0.239889 Jul 29 12:54:08.654350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 279/537] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:08 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:09.675572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:09.676394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:09.683048 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:09.683601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:09.684482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:09.684952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:09.720103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:09.720577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:09.721283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lazy-loading 'fault' on Instance uuid b1159bd7-b7c9-4745-b0c5-9c5207d8291d {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:09.770351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:09.779309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-62a5a017-40b5-47f1-a201-56edea716f13 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 200 len: 1331 microversion: 2.1 time: 0.107567 Jul 29 12:54:09.779874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 259/538] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:09 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:10.068082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-bd6452bb-c2da-4e90-b310-7d83fc6f015c req-4e00b5c7-3434-41c6-b60c-f797f7cb98a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1159bd7-b7c9-4745-b0c5-9c5207d8291d", "name": "network-vif-deleted", "tag": "3cabe18f-cd87-4cae-b162-144c5306bea8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:10.079484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-bd6452bb-c2da-4e90-b310-7d83fc6f015c req-4e00b5c7-3434-41c6-b60c-f797f7cb98a8 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:10.080035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-bd6452bb-c2da-4e90-b310-7d83fc6f015c req-4e00b5c7-3434-41c6-b60c-f797f7cb98a8 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:10.091339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-bd6452bb-c2da-4e90-b310-7d83fc6f015c req-4e00b5c7-3434-41c6-b60c-f797f7cb98a8 service nova] Creating event network-vif-deleted:3cabe18f-cd87-4cae-b162-144c5306bea8 for instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d on hv-cinder-81914 Jul 29 12:54:10.096450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-bd6452bb-c2da-4e90-b310-7d83fc6f015c req-4e00b5c7-3434-41c6-b60c-f797f7cb98a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Jul 29 12:54:10.097126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 280/539] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:10.803213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:10.803999 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:10.813478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:10.814192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:10.815397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:10.816163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:10.835370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d HTTP/1.1 Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:54:10.838968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:54:10.840493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'b1159bd7-b7c9-4745-b0c5-9c5207d8291d'} Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:54:10.841371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:54:10.842862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:10.844163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:54:10.844163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-73a19363-9a7e-4d0f-8cc6-8435ebdc0d30 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 404 len: 111 microversion: 2.1 time: 0.043827 Jul 29 12:54:10.844163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 260/540] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:10 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:54:10.855348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fd1697ae-9146-41ea-a378-8d9517c0c632 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '.version_select at 0x7f74a20bad30>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:10.879143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fd1697ae-9146-41ea-a378-8d9517c0c632 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791388067" status: 202 len: 0 microversion: 2.1 time: 0.031286 Jul 29 12:54:10.880421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 281/541] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Jul 29 12:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791388067 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:11.591330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:11.591774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:11.599943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:11.600397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:11.602521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:11.602980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:11.731824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lazy-loading 'services' on Instance uuid ef6fb941-1056-4618-8fd5-22dd72cf944f {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:11.846427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c45cf289-fc1b-4e37-9706-f347bbeac1af tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments/7b9f5a07-50c6-4405-a319-4dc398862a87" status: 202 len: 0 microversion: 2.1 time: 0.258892 Jul 29 12:54:11.847031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 261/542] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:54:11 2022] DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments/7b9f5a07-50c6-4405-a319-4dc398862a87 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:11.856233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:11.858521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:11.865648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:11.866121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:11.866887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:11.868543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:11.899636 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-925c19ce-c850-478c-b87e-8f5629266ef3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047733 Jul 29 12:54:11.900305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 282/543] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:54:11 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:12.913527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:12.916429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:12.923217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:12.923605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:12.924371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:12.924808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:12.952974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6867b971-ee7c-4a6b-8225-0e08e7acabc1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Jul 29 12:54:12.953511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 262/544] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:54:12 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:13.965029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:13.967205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:13.974743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:13.975188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:13.975954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:13.976441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:14.010913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4f88827e-cd31-4d78-aae5-b5589b1e358f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050268 Jul 29 12:54:14.011495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 283/545] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:54:13 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:14.906605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:14.909407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:14.916653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:14.917106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:14.917910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:14.918347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:14.942718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lazy-loading 'flavor' on Instance uuid 04a714f7-cb41-49d2-a3d9-548b76a88ff0 {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:15.023739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:15.026636 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:15.033099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.033593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.034380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.034820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.067239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e49cd0d4-22a1-495b-82be-f5f29f6d2b00 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047693 Jul 29 12:54:15.068545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 284/546] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:54:15 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:54:15.076022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-36e6112e-43d0-404d-9fc9-683b68cfa1bf tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/action" status: 200 len: 32 microversion: 2.1 time: 0.173253 Jul 29 12:54:15.077121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 263/547] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:54:14 2022] POST /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:54:15.087383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:15.088004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:15.094500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.094950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.095897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.096979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.157300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:15.157914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:15.164374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.164827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.165595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.166243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.196663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:54:15.227755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:15.244082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:15.252181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-91dc9770-6c1e-4b7a-8efe-631fdbb5f38d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.169734 Jul 29 12:54:15.252898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 285/548] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:15 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:15.286022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d4ac8b04-4db0-4add-a413-a1fa11e2e756 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 204 len: 0 microversion: 2.1 time: 0.132354 Jul 29 12:54:15.290515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 264/549] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:54:15 2022] DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:54:15.295659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:15.296384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:15.302564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.303091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.303863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:15.304350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:15.439224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:15.446812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-531118e8-68fe-47f9-8902-3ec60561ffd1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1681 microversion: 2.1 time: 0.154959 Jul 29 12:54:15.447314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 286/550] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:15 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:16.274774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:16.275465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:16.281786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:16.282258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:16.283012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:16.283447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:16.412708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:16.421125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0fe409f4-ac04-456a-9ccd-07d8191e56ca tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.150501 Jul 29 12:54:16.421681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 265/551] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:16 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:16.467724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:16.468342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:16.475172 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:16.475628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:16.477022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:16.477463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:16.605217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:16.612644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-60dcf67a-536e-4487-a94b-e200c37685f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1681 microversion: 2.1 time: 0.148748 Jul 29 12:54:16.613212 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 287/552] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:16 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:17.443760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:17.444375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:17.451823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:17.452282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:17.453045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:17.453488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:17.634768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:17.635302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:17.642638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:17.642931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:17.643698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:17.644132 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:17.644830 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:17.657896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1e334c49-e372-46e0-9d44-93ee40c02232 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.219268 Jul 29 12:54:17.658816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 266/553] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:17 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:17.930111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:17.937546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-475e4d79-47a0-4eb1-9655-064414b007f0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1681 microversion: 2.1 time: 0.306865 Jul 29 12:54:17.938272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 288/554] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:17 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:18.680585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:18.681199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:18.687775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:18.688231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:18.689339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:18.689453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:18.825789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:18.833839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7c4cc075-da85-4509-8111-f575bd06844b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.157767 Jul 29 12:54:18.834410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 267/555] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:18 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:18.869111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-e21e8787-db50-432b-957e-e0a7785abf18 req-16a948f4-ed84-4ebc-8c12-427428739169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef6fb941-1056-4618-8fd5-22dd72cf944f", "name": "network-vif-deleted", "tag": "0d4aeb43-0283-4dc4-ac92-c1ff81c544b8"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:18.885972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-e21e8787-db50-432b-957e-e0a7785abf18 req-16a948f4-ed84-4ebc-8c12-427428739169 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:18.886732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-e21e8787-db50-432b-957e-e0a7785abf18 req-16a948f4-ed84-4ebc-8c12-427428739169 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:18.902058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-e21e8787-db50-432b-957e-e0a7785abf18 req-16a948f4-ed84-4ebc-8c12-427428739169 service nova] Creating event network-vif-deleted:0d4aeb43-0283-4dc4-ac92-c1ff81c544b8 for instance ef6fb941-1056-4618-8fd5-22dd72cf944f on hv-cinder-81914 Jul 29 12:54:18.916111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-e21e8787-db50-432b-957e-e0a7785abf18 req-16a948f4-ed84-4ebc-8c12-427428739169 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051092 Jul 29 12:54:18.916727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 289/556] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:18.959876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:18.961139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:18.968749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:18.969454 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:18.970539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:18.971469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:19.013479 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:19.014194 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:19.015032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lazy-loading 'fault' on Instance uuid ef6fb941-1056-4618-8fd5-22dd72cf944f {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:19.062616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:19.072157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d1fde623-615e-423d-8253-f369c52982fc tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 200 len: 1330 microversion: 2.1 time: 0.116628 Jul 29 12:54:19.072842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 268/557] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:18 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:19.856445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:19.857139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:19.863356 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:19.863811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:19.864605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:19.865041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:20.003530 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:20.012148 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-683ddfcf-8ccc-4e42-8a45-6cb407a85277 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.159999 Jul 29 12:54:20.012709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 290/558] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:19 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:20.093469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:20.094237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:20.096980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:20.102934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:20.103391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:20.104153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:20.104602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:20.118391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f HTTP/1.1 Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:54:20.120038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:54:20.121331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'ef6fb941-1056-4618-8fd5-22dd72cf944f'} Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:54:20.122088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:54:20.123762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:54:20.125123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:54:20.125123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3558b30a-f527-42f0-91c7-d45c0b7eb723 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 404 len: 111 microversion: 2.1 time: 0.031897 Jul 29 12:54:20.125123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 269/559] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:20 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:54:20.130355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2438d43f-b6cd-4b10-97a8-c09ceea71a33 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '.version_select at 0x7f74a20a8790>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:20.149680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2438d43f-b6cd-4b10-97a8-c09ceea71a33 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491929470" status: 202 len: 0 microversion: 2.1 time: 0.022983 Jul 29 12:54:20.150200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 291/560] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Jul 29 12:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491929470 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:20.797205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-93288eb6-c0ec-46a7-94a6-77880a41612d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: .version_select at 0x7f74a1eacb80>, body: {"keypair": {"name": "tempest-keypair-2010643937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJrGRq0gI7MlwSwsXei5Tjb0S0JbYOCaSyAVejJM56CDb0SgSS1KS3gUaOjGEAf/uRl1jb3LuKKxZ8fKpeqpekgvzWPP1YueGe1pe8mxRIiydFtduJiao0hTYiiYz+zsg=="}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:20.813451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-93288eb6-c0ec-46a7-94a6-77880a41612d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:54:20.817290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-93288eb6-c0ec-46a7-94a6-77880a41612d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:54:20.844219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-93288eb6-c0ec-46a7-94a6-77880a41612d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050814 Jul 29 12:54:20.844811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 270/561] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:54:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:21.033970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:21.034582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:21.040646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:21.041290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:21.042091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:21.042531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:21.203802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:21.209938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:21.217800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fc48a3df-956d-42a6-a3d1-13cc2ca85d8d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.188149 Jul 29 12:54:21.218612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 292/562] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:21 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:22.132098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-275429148", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3"}], "security_groups": [{"name": "tempest-securitygroup--51350647"}], "key_name": "tempest-keypair-2010643937", "user_data": "}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:22.235544 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] validate_networks() for [('2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:54:22.239369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:22.239972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:22.247977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:22.248424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:22.249194 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:22.249624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:22.394264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:22.402375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3fc9cbb-4139-469b-819e-3739975834ef tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.166812 Jul 29 12:54:22.403017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 293/563] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:22 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:22.611160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:54:22.611591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:54:22.612065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:54:22.612495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:54:22.612914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:54:22.622192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:22.622639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:22.623439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:22.623880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:22.640692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:54:22.644814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:54:22.656246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:54:22.658582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:54:22.703778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-edce6909-df39-45fe-a35f-db55600f07dd tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.578307 Jul 29 12:54:22.704409 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 271/564] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:54:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:54:22.715814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fddb81f3-089d-492b-8e5f-dbccc9ffa645 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:22.716415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fddb81f3-089d-492b-8e5f-dbccc9ffa645 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:22.770550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fddb81f3-089d-492b-8e5f-dbccc9ffa645 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:22.778037 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fddb81f3-089d-492b-8e5f-dbccc9ffa645 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1241 microversion: 2.1 time: 0.066098 Jul 29 12:54:22.788489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 294/565] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:22 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:23.424061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:23.424594 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:23.432356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:23.432819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:23.433609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:23.434090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:23.566672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:23.575162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8ee4ea51-3439-486c-8cab-a4de6d900cdc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.155223 Jul 29 12:54:23.575718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 272/566] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:23 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:23.798811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:23.800150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:23.808112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:23.808566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:23.810214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:23.810684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:23.882041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:23.889781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-91d463e9-7910-4d67-ab13-011be1441ea0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1301 microversion: 2.1 time: 0.095056 Jul 29 12:54:23.893939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 295/567] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:23 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:24.596501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:24.597104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:24.604135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:24.604820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:24.605585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:24.606081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:24.911529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:24.912954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:24.921778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:24.922656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:24.923661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:24.924335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:25.098669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:25.116382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5f523f15-5e45-41bc-932e-0c0311054715 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.523909 Jul 29 12:54:25.130418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 273/568] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:24 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:25.163192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:25.171358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5998624c-c757-4ee3-9da0-2cccf020a3ee tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.264256 Jul 29 12:54:25.171932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 296/569] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:24 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:25.416734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-49da6e81-f80b-41bb-8bd6-8e841e95e577 req-65c51b56-9faf-4bdf-8033-e9d0e9a000bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9", "tag": "d81dc7a5-0481-4a46-b518-0038f49493f5"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:25.429081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-49da6e81-f80b-41bb-8bd6-8e841e95e577 req-65c51b56-9faf-4bdf-8033-e9d0e9a000bf service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:25.430128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-49da6e81-f80b-41bb-8bd6-8e841e95e577 req-65c51b56-9faf-4bdf-8033-e9d0e9a000bf service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:25.450440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-49da6e81-f80b-41bb-8bd6-8e841e95e577 req-65c51b56-9faf-4bdf-8033-e9d0e9a000bf service nova] Creating event network-changed:d81dc7a5-0481-4a46-b518-0038f49493f5 for instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 on hv-cinder-81914 Jul 29 12:54:25.457429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-49da6e81-f80b-41bb-8bd6-8e841e95e577 req-65c51b56-9faf-4bdf-8033-e9d0e9a000bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044961 Jul 29 12:54:25.459108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 274/570] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:26.137811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:26.138546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:26.145296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:26.145853 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:26.146675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:26.147150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:26.193519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:26.194234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:26.200469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:26.200922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:26.201683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:26.202154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:26.276930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:26.284962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3079575a-b721-4f04-abca-5b9b1545376a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.151376 Jul 29 12:54:26.285584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 297/571] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:26 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:26.337086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:26.345019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-acb4644d-56ff-4095-9a70-dd59523d1694 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.156216 Jul 29 12:54:26.345587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 275/572] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:26 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:27.305961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:27.306581 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:27.314067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:27.314527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:27.315300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:27.315737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:27.366166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:27.367389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:27.373845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:27.374274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:27.375073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:27.375512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:27.453360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:27.461634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-795e97ab-bc85-45f3-8fe0-0750eb7c45c1 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.159528 Jul 29 12:54:27.462282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 298/573] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:27 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:27.504807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:27.512211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8d146d46-ae16-4c9c-9b6f-d586e600486f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.149908 Jul 29 12:54:27.512776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 276/574] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:27 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:28.485908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:28.486458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:28.493497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:28.493967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:28.494746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:28.495177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:28.532435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:28.533043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:28.539682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:28.540133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:28.540904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:28.541343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:28.625713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:28.633883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5d0cb9fb-7391-4f77-9a30-d4d93337ad53 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.151882 Jul 29 12:54:28.634545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 299/575] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:28 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:28.676982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:28.684458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fd4d0814-5949-4204-a581-6dcfb7b95eb5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.155874 Jul 29 12:54:28.685010 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 277/576] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:28 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:29.655017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:29.655625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:29.658110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:29.664667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:29.665130 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:29.666249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:29.666693 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:29.704666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:29.705258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:29.711551 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:29.711994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:29.712764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:29.713204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:29.799202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:29.808144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7fe05481-507e-455e-a1dd-c0e93be01a8a tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.156822 Jul 29 12:54:29.822103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 300/577] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:29 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:29.853999 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:29.861391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2e700a63-b97a-44ae-96a3-005c445c0601 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.160743 Jul 29 12:54:29.861989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 278/578] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:29 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:30.830863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:30.831476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:30.838021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:30.838484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:30.839247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:30.839695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:30.880829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:30.881443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:30.888734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:30.889187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:30.890016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:30.890660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:30.973373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:30.981722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a1172b11-8e8e-4918-bab8-b0bdc7260a72 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.154852 Jul 29 12:54:30.982328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 301/579] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:30 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:31.020871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:31.028858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-649edb14-ec32-4b7c-be23-6f0954703ed8 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.151865 Jul 29 12:54:31.029414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 279/580] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:30 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:32.003663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:32.004305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:32.011544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:32.011999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:32.012767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:32.013206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:32.069233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:32.074192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:32.081644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:32.082129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:32.082910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:32.083347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:32.173736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:32.189499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-be00ae73-6fae-4e30-9259-637e34331a60 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.183196 Jul 29 12:54:32.194003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 302/581] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:31 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:32.200180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-a3c014f6-c2d4-4210-b165-12c27b967eca req-f66fe7da-f115-4114-8181-877416026c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9", "name": "network-vif-plugged", "status": "completed", "tag": "d81dc7a5-0481-4a46-b518-0038f49493f5"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:32.209794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-a3c014f6-c2d4-4210-b165-12c27b967eca req-f66fe7da-f115-4114-8181-877416026c24 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:32.210886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-a3c014f6-c2d4-4210-b165-12c27b967eca req-f66fe7da-f115-4114-8181-877416026c24 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:32.221756 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-a3c014f6-c2d4-4210-b165-12c27b967eca req-f66fe7da-f115-4114-8181-877416026c24 service nova] Creating event network-vif-plugged:d81dc7a5-0481-4a46-b518-0038f49493f5 for instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 on hv-cinder-81914 Jul 29 12:54:32.227078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-a3c014f6-c2d4-4210-b165-12c27b967eca req-f66fe7da-f115-4114-8181-877416026c24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 Jul 29 12:54:32.227902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 303/582] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:32.228030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:32.235460 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-176b74d2-b870-46a4-9dfd-5b9810ee6cc6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.176427 Jul 29 12:54:32.236014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 280/583] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:32 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:33.207605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:33.213101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:33.213846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:33.220396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:33.220879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:33.221938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:33.222379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:33.256271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:33.256885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:33.258929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:33.259687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=10 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:33.266300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:33.266756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:33.267530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:33.267972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:33.366568 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:33.374671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-431c67c0-1cab-4a2a-a9bc-737625372740 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.167887 Jul 29 12:54:33.375155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 304/584] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:33 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:33.407782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:33.415115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f7900263-45d3-419e-9370-c6ee818f439f tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.162655 Jul 29 12:54:33.415675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 281/585] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:33 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:34.396554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:34.397092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:34.403625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:34.404075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:34.404831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:34.405272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:34.436230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:34.436872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:34.443659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:34.444139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:34.445023 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:34.445470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:34.540295 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:34.548350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-40807a8f-54b1-4af5-ac97-1d528f23f1d3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.155632 Jul 29 12:54:34.548920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 305/586] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:34 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:34.582852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:34.590824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1bba28d2-53e9-4bbc-a1c8-d0778b062359 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1365 microversion: 2.1 time: 0.158452 Jul 29 12:54:34.591391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 282/587] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:34 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:35.570792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:35.571405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:35.578015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:35.578473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:35.579335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:35.579678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:35.612088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:35.612840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:35.619401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:35.619893 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:35.620665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:35.621107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:35.625522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:35.713396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:35.721745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8cb598f3-4ceb-487f-98fb-dee7e055f9d2 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.155014 Jul 29 12:54:35.722344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 306/588] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:35 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:35.756166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:35.764286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7cc6f405-b001-435a-93c8-3153eb1b9f1e tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1555 microversion: 2.1 time: 0.155943 Jul 29 12:54:35.764847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 283/589] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:35 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:35.785021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:35.785530 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:35.791608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:35.792076 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:35.792875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:35.793332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:35.870839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1dee11e7-1277-4bc6-829a-6e3ee626c29d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089882 Jul 29 12:54:35.871459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 307/590] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:54:35 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:36.744099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:36.744769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:36.751351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:36.751806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:36.752601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:36.753045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:36.883638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:36.892538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a37d5087-984a-499f-b6c3-e6a2057ae5c8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1735 microversion: 2.1 time: 0.152775 Jul 29 12:54:36.893237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 284/591] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:36 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:37.092334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-25e938c2-5896-407e-8355-7d69c0615314 req-bd8c2802-4d61-403c-9134-23bf05da0499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9", "tag": "d81dc7a5-0481-4a46-b518-0038f49493f5"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:37.102196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-25e938c2-5896-407e-8355-7d69c0615314 req-bd8c2802-4d61-403c-9134-23bf05da0499 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:37.102642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-25e938c2-5896-407e-8355-7d69c0615314 req-bd8c2802-4d61-403c-9134-23bf05da0499 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:37.113862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-25e938c2-5896-407e-8355-7d69c0615314 req-bd8c2802-4d61-403c-9134-23bf05da0499 service nova] Creating event network-changed:d81dc7a5-0481-4a46-b518-0038f49493f5 for instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 on hv-cinder-81914 Jul 29 12:54:37.119014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-25e938c2-5896-407e-8355-7d69c0615314 req-bd8c2802-4d61-403c-9134-23bf05da0499 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Jul 29 12:54:37.119675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 308/592] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:37.915068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:37.915676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:37.922562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:37.923020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:37.923804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:37.924240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.066910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:38.075240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-239119a7-b7c5-4c60-8d99-fcc4360cb15b tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1715 microversion: 2.1 time: 0.164485 Jul 29 12:54:38.075825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 285/593] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:37 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:38.194065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:38.196206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:38.203065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:38.203601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.204697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:38.205340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.334489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] HTTP exception thrown: Cannot 'detach_volume' instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 while it is in vm_state rescued Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Request method failure captured: Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments/bf73bc5c-989f-4e67-ac96-cbef0d3d4a43 HTTP/1.1 Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eRa0q_DgInPevO1z84sH37ZI1Mvwr4czUglHFjXqXy7ltot0wnWU-IMbqJJ8NCi6rhIv8kM5Zk0N56Yf4tNk_aGZOt3sNgq46u91ql66RqyLU0QJZAJW1ZRzBtmEOHfuWdq_RCTt69PavK-gC4ddGmgJLnO60JNEZCVPEwnfStPcI Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:54:38.336639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 1dd24e8c0d214a0bb62578f9834a40a2 Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:54:38.338293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Cannot 'detach_volume' instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 while it is in vm_state rescued Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'server_id': '04a714f7-cb41-49d2-a3d9-548b76a88ff0', 'id': 'bf73bc5c-989f-4e67-ac96-cbef0d3d4a43'} Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:54:38.339070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 while it is in vm_state rescued Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 while it is in vm_state rescued Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:38.340692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Returning 409 to user: Cannot 'detach_volume' instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 while it is in vm_state rescued {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:54:38.341934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9c7e5c22-81f3-4e25-8528-80ddba5285ae tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments/bf73bc5c-989f-4e67-ac96-cbef0d3d4a43" status: 409 len: 152 microversion: 2.1 time: 0.150418 Jul 29 12:54:38.341934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 309/594] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:54:38 2022] DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments/bf73bc5c-989f-4e67-ac96-cbef0d3d4a43 => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 12:54:38.347511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:38.348054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:38.354302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:38.354758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.355558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:38.356000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.421089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c6fd0c8a-8a84-4bd3-9ff5-aeb8a19d3343 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "POST /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/action" status: 202 len: 0 microversion: 2.1 time: 0.077552 Jul 29 12:54:38.424840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 286/595] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:54:38 2022] POST /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:38.430916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:38.431675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:38.439743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:38.440426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.441211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:38.441682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:38.668870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:38.676845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-40a44060-ab78-4e2d-bc0d-61f89ae97352 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1723 microversion: 2.1 time: 0.250708 Jul 29 12:54:38.677486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 310/596] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:38 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:39.700445 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:39.701256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:39.707843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:39.708300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:39.709070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:39.709515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:39.839451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:39.848085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-af305dcf-406f-46d5-9473-563c13ed0a84 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1723 microversion: 2.1 time: 0.152639 Jul 29 12:54:39.848693 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 287/597] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:39 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:40.870350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:40.870972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:40.877554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:40.878046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:40.878810 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:40.879254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:41.008661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:41.016592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3281a056-1ab6-4be9-a0b9-b8fae544d9cd tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1723 microversion: 2.1 time: 0.150714 Jul 29 12:54:41.017154 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 311/598] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:40 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:42.044338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:42.044952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:42.051774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:42.052232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:42.053005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:42.053455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:42.196528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:42.204786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-680ddc5e-b6cb-400d-a0c0-0aba96422fdb tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1723 microversion: 2.1 time: 0.164266 Jul 29 12:54:42.205416 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 288/599] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:42 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:43.226134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:43.226742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:43.233285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:43.233802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:43.234583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:43.235016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:43.239064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:43.370429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:43.378366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5656e814-9dc1-4521-a4d8-452222e93fc9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1729 microversion: 2.1 time: 0.156955 Jul 29 12:54:43.378925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 312/600] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:43 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:43.398561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:43.399062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:43.405556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:43.406056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:43.406827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:43.407273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:43.484449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-354dea4b-7464-4c26-a559-38c92892e170 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089687 Jul 29 12:54:43.485036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 289/601] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:54:43 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:44.372846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-17f23d83-2be8-45dd-adaf-c9f299ae27cd req-daf9a434-1d44-4238-bc9e-0597ea55af8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a714f7-cb41-49d2-a3d9-548b76a88ff0", "tag": "554bff31-bbb8-4e37-b051-7ae3996fa046"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:44.383725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-17f23d83-2be8-45dd-adaf-c9f299ae27cd req-daf9a434-1d44-4238-bc9e-0597ea55af8c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:44.384268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-17f23d83-2be8-45dd-adaf-c9f299ae27cd req-daf9a434-1d44-4238-bc9e-0597ea55af8c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:44.395574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-17f23d83-2be8-45dd-adaf-c9f299ae27cd req-daf9a434-1d44-4238-bc9e-0597ea55af8c service nova] Creating event network-changed:554bff31-bbb8-4e37-b051-7ae3996fa046 for instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 on hv-cinder-81914 Jul 29 12:54:44.401057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-17f23d83-2be8-45dd-adaf-c9f299ae27cd req-daf9a434-1d44-4238-bc9e-0597ea55af8c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032102 Jul 29 12:54:44.401744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 313/602] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:46.416595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-ea256dcd-0153-448f-aad6-c803f8e502a3 req-57985c1b-0f15-47ce-b381-c818338651b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a714f7-cb41-49d2-a3d9-548b76a88ff0", "tag": "554bff31-bbb8-4e37-b051-7ae3996fa046"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:46.426228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ea256dcd-0153-448f-aad6-c803f8e502a3 req-57985c1b-0f15-47ce-b381-c818338651b3 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:46.426676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ea256dcd-0153-448f-aad6-c803f8e502a3 req-57985c1b-0f15-47ce-b381-c818338651b3 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:46.438321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-ea256dcd-0153-448f-aad6-c803f8e502a3 req-57985c1b-0f15-47ce-b381-c818338651b3 service nova] Creating event network-changed:554bff31-bbb8-4e37-b051-7ae3996fa046 for instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 on hv-cinder-81914 Jul 29 12:54:46.443141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-ea256dcd-0153-448f-aad6-c803f8e502a3 req-57985c1b-0f15-47ce-b381-c818338651b3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031321 Jul 29 12:54:46.443774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 290/603] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:47.991562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:47.992194 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:47.998600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:47.999040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:47.999784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.000210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:48.023472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lazy-loading 'flavor' on Instance uuid 1bfcd2b5-60b2-4174-aecd-50476a218c1f {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:48.128704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f6571bcb-ae3a-418f-99ff-a17b2e585963 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "POST /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.141723 Jul 29 12:54:48.130156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 314/604] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:54:47 2022] POST /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:48.138816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:48.139550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:48.145924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.146383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:48.147694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.148141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:48.282665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:48.291031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-80b316af-3c35-4286-b538-1aa2455471ea tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.157045 Jul 29 12:54:48.291598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 291/605] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:48 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:48.823190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:48.823816 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:48.831419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.831907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:48.832717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.833195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:48.864058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8dd66ce1-48fb-419c-854f-1286e9c527b5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments/684e63d4-86a8-4b05-a8c3-76df28567571" status: 200 len: 194 microversion: 2.20 time: 0.048213 Jul 29 12:54:48.864647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 315/606] 10.222.0.66 () {60 vars in 1454 bytes} [Fri Jul 29 12:54:48 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments/684e63d4-86a8-4b05-a8c3-76df28567571 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:54:48.932174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:48.932664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:48.938709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.939153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:48.939900 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:48.940329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:49.019728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lazy-loading 'services' on Instance uuid 9a58e30f-f1a3-4c6b-8b99-00a393888dfb {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:49.092042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b1813643-ec3d-46e8-bd68-f97de09c4318 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments/684e63d4-86a8-4b05-a8c3-76df28567571" status: 202 len: 0 microversion: 2.20 time: 0.163767 Jul 29 12:54:49.092697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 292/607] 10.222.0.66 () {60 vars in 1457 bytes} [Fri Jul 29 12:54:48 2022] DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments/684e63d4-86a8-4b05-a8c3-76df28567571 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:54:49.101862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:49.104023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:49.110665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:49.111127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:49.111902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:49.112344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:49.143943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-19caf154-d544-4557-b203-a0c34597484b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046240 Jul 29 12:54:49.144508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 316/608] 10.222.0.66 () {60 vars in 1343 bytes} [Fri Jul 29 12:54:49 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:54:49.313754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:49.314510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:49.321049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:49.321498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:49.322287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:49.322727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:49.455419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:49.463461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-249c6be9-0abc-4882-aa6b-8a723724e4b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.154987 Jul 29 12:54:49.464029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 293/609] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:49 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:49.972939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:49.973493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:49.979985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:49.980464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:49.981280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:49.981772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.060773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lazy-loading 'services' on Instance uuid 80d9675c-1827-4d5f-9ffc-2ec302ef475c {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:50.157061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:50.159985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:50.163235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:50.169272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.169844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.170814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.171436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.178825 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-843cc5a4-0596-47c7-a8b8-20e5246557bf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-volume_attachments/0c4eda24-95b4-49fd-aa10-38c357ded5cf" status: 202 len: 0 microversion: 2.1 time: 0.210312 Jul 29 12:54:50.179665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 317/610] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:54:49 2022] DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-volume_attachments/0c4eda24-95b4-49fd-aa10-38c357ded5cf => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:50.204989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-420ab2ba-04f4-49c5-a2f5-a34d7c782e8f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052184 Jul 29 12:54:50.205575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 294/611] 10.222.0.66 () {60 vars in 1343 bytes} [Fri Jul 29 12:54:50 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:50.275429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:50.276005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:50.282340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.282801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.283554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.284590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.310448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:54:50.384205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-912565b7-add3-4967-aebd-82b5a7f0dfeb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 204 len: 0 microversion: 2.20 time: 0.113184 Jul 29 12:54:50.384838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 318/612] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Jul 29 12:54:50 2022] DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 12:54:50.393443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:50.394151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:50.401312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.401812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.402667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.403132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.486645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:50.487439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:50.494174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.494704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.495477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:50.495914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:50.532804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:50.541270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:50.542883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:50.544078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a7370400-00df-4380-aace-b92f6340e87e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.154682 Jul 29 12:54:50.544637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 295/613] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:50 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:54:50.637303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:50.645106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-efb79c07-5e2d-462d-a730-bec0ecb37667 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.162642 Jul 29 12:54:50.645673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 319/614] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:50 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:51.567849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:51.568480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:51.575011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:51.575459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:51.576216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:51.576653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:51.667436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:51.668247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:51.675042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:51.675521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:51.676379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:51.676820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:51.708669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:51.718070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:51.719575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:51.720727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c98d7809-f81e-4cba-8f8f-b5634a38bd5f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.156771 Jul 29 12:54:51.721546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 296/615] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:51 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:54:51.815202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:51.822774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e1c89405-637f-4adc-afe8-40624cfa4750 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.159097 Jul 29 12:54:51.823290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 320/616] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:51 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:52.180280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:52.182610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:52.190955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.191405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.192176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.192678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.266296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8b36b160-e5dd-4541-a3f8-869fc2a78181 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/action" status: 202 len: 0 microversion: 2.1 time: 0.090185 Jul 29 12:54:52.266916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 297/617] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:54:52 2022] POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:52.275042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:52.275648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:52.281967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.282407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.283160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.283590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.429696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:52.437976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-655ae9c8-cffc-4e74-acfc-f52d3047d348 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1750 microversion: 2.1 time: 0.166679 Jul 29 12:54:52.438727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 321/618] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:52 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:52.744813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:52.746145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:52.753139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.753588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.754376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.754808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.758957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:52.844751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:52.845453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:52.852749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.853200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:52.854036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:52.854665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.024706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:53.034882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:53.036733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:53.038442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c62090d1-efd5-43e6-8f3e-a5c8859254f8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1721 microversion: 2.20 time: 0.298182 Jul 29 12:54:53.039156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 298/619] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:52 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:54:53.102524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:53.121618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7f329e47-5318-44a7-b367-93a9e84ef88a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.280743 Jul 29 12:54:53.122606 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 322/620] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:52 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:53.430728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-07957979-a99a-4511-8f74-f9747dd7a72f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:53.437274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-07957979-a99a-4511-8f74-f9747dd7a72f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:53.437743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-07957979-a99a-4511-8f74-f9747dd7a72f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.459717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:53.460680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:53.463108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-07957979-a99a-4511-8f74-f9747dd7a72f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Going to try to stop instance {{(pid=129323) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 12:54:53.473591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:53.474209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.475092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:53.475608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.517587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-07957979-a99a-4511-8f74-f9747dd7a72f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action" status: 202 len: 0 microversion: 2.1 time: 0.090862 Jul 29 12:54:53.518573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 299/621] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:54:53 2022] POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:54:53.526687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-79532200-7657-4bc0-a256-baeecb2be4bd req-0d714f27-ca8c-450b-907d-e5d84b06aafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a58e30f-f1a3-4c6b-8b99-00a393888dfb", "name": "network-vif-deleted", "tag": "beb71c54-25c8-4f1d-89fb-11a56e0858a6"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:53.540699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-79532200-7657-4bc0-a256-baeecb2be4bd req-0d714f27-ca8c-450b-907d-e5d84b06aafe service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:53.540699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-79532200-7657-4bc0-a256-baeecb2be4bd req-0d714f27-ca8c-450b-907d-e5d84b06aafe service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.554909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-79532200-7657-4bc0-a256-baeecb2be4bd req-0d714f27-ca8c-450b-907d-e5d84b06aafe service nova] Creating event network-vif-deleted:beb71c54-25c8-4f1d-89fb-11a56e0858a6 for instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb on hv-cinder-81914 Jul 29 12:54:53.561113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-79532200-7657-4bc0-a256-baeecb2be4bd req-0d714f27-ca8c-450b-907d-e5d84b06aafe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040887 Jul 29 12:54:53.562606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 300/622] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:54:53.569154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:53.574331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:53.581105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:53.581560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.582375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:53.584329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:53.705426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:53.720327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-39bb308f-b1ed-4f31-89dc-58541966772a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.264340 Jul 29 12:54:53.721466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 323/623] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:53 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:53.747538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:53.757318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-62fe3c24-3ed2-4172-a391-6fb87ecf3afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.193447 Jul 29 12:54:53.758655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 301/624] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:53 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:54.062070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:54.062712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:54.069316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.069771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.070572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.071043 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.103385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.103836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.104645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lazy-loading 'fault' on Instance uuid 9a58e30f-f1a3-4c6b-8b99-00a393888dfb {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:54:54.144206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:54.145342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:54.153556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.154066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.154864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.155111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:54.155447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.158666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:54:54.170131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:54.172125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:54.174216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a1b0f690-5845-45a3-85d0-42afa0fc9313 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 200 len: 1370 microversion: 2.20 time: 0.115451 Jul 29 12:54:54.174871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 324/625] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:54 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 1370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:54:54.320783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:54.328552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-46551531-b352-44b3-a33c-0098380ba1b6 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.188611 Jul 29 12:54:54.329120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 302/626] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:54 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:54.743099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:54.743708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:54.750486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.750932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.751682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.752112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.778646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:54.779341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:54.785969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.786436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.787212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:54.787732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:54.900963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:54.908950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3b547c52-fc25-4ec1-abea-d1225a8efd50 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.170062 Jul 29 12:54:54.909733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 325/627] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:54 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:54.920264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:54.927794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-11d08601-4ffa-4f9b-9f6d-960549f094c1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.152973 Jul 29 12:54:54.928418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 303/628] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:54 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:55.198664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:55.199303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:55.205730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.206213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.206971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.207406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.220963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] HTTP exception thrown: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Request method failure captured: Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb HTTP/1.1 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eTFRgGbWfNrlwM7cnKYargSzBwedC0koS6a-H581aUEPO7MPgt74a3lpfgSbLUMSHQNemDd0pwtl9Q48pf1Ps06KWk8B0q_Ik2E7_A7zkTsIl01qaECrl_D0g0zQCikOtspuPvLhBM4qXZ6qxmi8gWhzWGo8SQ-ZcNasNZg6h2-XE Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:54:55.222852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: e7ee2c3480f8483bb76ecc686215720b Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:54:55.224351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '9a58e30f-f1a3-4c6b-8b99-00a393888dfb'} Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:54:55.225654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:54:55.227187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:54:55.228736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Returning 404 to user: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:54:55.228736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8a10db35-5af7-4fe7-b436-889d8cbfaf80 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 404 len: 111 microversion: 2.20 time: 0.029464 Jul 29 12:54:55.228736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 326/629] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:55 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:54:55.233758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a24c0c68-d79a-4acb-bd40-dd525237808b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '.version_select at 0x7f74a1e4b310>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:55.253499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a24c0c68-d79a-4acb-bd40-dd525237808b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281023360" status: 204 len: 0 microversion: 2.20 time: 0.023514 Jul 29 12:54:55.254070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 304/630] 10.222.0.66 () {60 vars in 1259 bytes} [Fri Jul 29 12:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281023360 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 12:54:55.350947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:55.351554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:55.357545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.358035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.358801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.359238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.523546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:55.531401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-35fb708e-59a6-45cb-beee-e940e88a7836 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.185052 Jul 29 12:54:55.531995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 327/631] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:55 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:55.880005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1faa241f-13ce-46d7-8150-6ee223e3c5d6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'create', calling method: .version_select at 0x7f74a1df8af0>, body: {"keypair": {"name": "tempest-keypair-1190335846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsaBU631gxEULAQSi3o+2Uzr9a/jZP/9UkJqR6GtytAepjTWaPpS0RsoS6iwWsyXfFP8GWdkSevF9gJLew7gBetpB7yVgJ7GcZAwuzngYgFPcGrpyhzSfY8RxSZibqnFQ=="}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:55.896456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-1faa241f-13ce-46d7-8150-6ee223e3c5d6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:54:55.900923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-1faa241f-13ce-46d7-8150-6ee223e3c5d6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for user e7ee2c3480f8483bb76ecc686215720b and project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:54:55.922063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1faa241f-13ce-46d7-8150-6ee223e3c5d6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046554 Jul 29 12:54:55.922648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 305/632] 10.222.0.66 () {62 vars in 1200 bytes} [Fri Jul 29 12:54:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 12:54:55.932959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:55.933627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:55.939646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.940087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.940842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.941274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.952671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:55.953393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:55.960541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.961007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:55.961981 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:55.962434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:56.108309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:56.124233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-316b3248-9548-4abb-aa5e-10dd247d2e12 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.194278 Jul 29 12:54:56.124233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 328/633] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:55 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:56.164101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:56.173575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5a8f1eb5-99f9-43f7-b792-044aa9db1bd7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.225497 Jul 29 12:54:56.181285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 306/634] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:55 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:56.552472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:56.553331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:56.559827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:56.560355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:56.561024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:56.561452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:56.778514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:56.786184 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5226ca5c-24d1-4129-a991-f55c12a09f63 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.237554 Jul 29 12:54:56.786750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 329/635] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:56 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:57.144514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:57.145125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:57.151707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.152295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.153067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.153517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.207985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:57.208896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:57.215236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.215757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.216588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.217018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.304736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:57.313130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-83668e44-6e86-4f38-84a5-70224436b31a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.172434 Jul 29 12:54:57.313709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 307/636] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:57 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:57.321159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-875925294", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea4321cb-e5ed-4859-84aa-a7f6d2ae9505"}], "security_groups": [{"name": "tempest-securitygroup--1621485029"}], "key_name": "tempest-keypair-1190335846", "user_data": "}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:54:57.360461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:57.368511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2c47b684-c18d-4b18-a4be-896ebd0c5969 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.170260 Jul 29 12:54:57.369081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 330/637] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:57 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:57.425362 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] validate_networks() for [('ea4321cb-e5ed-4859-84aa-a7f6d2ae9505', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:54:57.795382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:54:57.795811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:54:57.796292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:54:57.796703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:54:57.797122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:54:57.806599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.807050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.807854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.808293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.808540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:57.809156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:57.815561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.816014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.816784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:57.817223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:57.825588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:54:57.829574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Getting quotas for user e7ee2c3480f8483bb76ecc686215720b and project 89441418bb3d4ff6ad1a0b466e69cfb6. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:54:57.840833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:54:57.843179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:54:57.890400 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-59d29df0-2c02-4952-9393-4e6335e0e55b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575040 Jul 29 12:54:57.891245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 308/638] 10.222.0.66 () {62 vars in 1188 bytes} [Fri Jul 29 12:54:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 12:54:57.902297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3da8ee44-21f7-4a30-803b-dc6f727f0252 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:57.903432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3da8ee44-21f7-4a30-803b-dc6f727f0252 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:57.966367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3da8ee44-21f7-4a30-803b-dc6f727f0252 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:57.969183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:57.977313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3da8ee44-21f7-4a30-803b-dc6f727f0252 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:57.977457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-913f60d1-3bbd-49b0-bfb9-7fce00152a98 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.172629 Jul 29 12:54:57.977959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 331/639] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:57 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:57.979201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3da8ee44-21f7-4a30-803b-dc6f727f0252 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:57.980172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3da8ee44-21f7-4a30-803b-dc6f727f0252 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1281 microversion: 2.20 time: 0.082025 Jul 29 12:54:57.980846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 309/640] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:57 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:54:58.335480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:58.336083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:58.342706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:58.343184 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:58.343937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:58.344368 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:58.390288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:58.391036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:58.397575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:58.398068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:58.398841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:58.399286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:58.492178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:58.500955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f5452780-b6f0-4927-8a8e-94e801d95e4a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.169276 Jul 29 12:54:58.501581 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 332/641] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:58 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:58.534547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:58.542300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-44658501-a0ce-48d4-9ee2-f0584161015e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.155836 Jul 29 12:54:58.542873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 310/642] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:58 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:54:58.999435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:59.000039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:59.002893 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:59.003502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:59.007195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.007638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.008395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.008830 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.010089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.010550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.011314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.011831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.073321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:59.081499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:59.083043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:59.084152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4f11e616-a804-4eb8-84c8-0da1b7dc02ae tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1333 microversion: 2.20 time: 0.085628 Jul 29 12:54:59.085306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 311/643] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:54:58 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:54:59.149478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:59.157719 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-56c6fca2-7147-4879-a4da-13c1ffb36a58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.162404 Jul 29 12:54:59.159033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 333/644] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:58 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:59.522886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:59.523492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:59.530063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.530494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.531256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.531687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.564521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:54:59.565134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:54:59.575182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.575877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.579628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:54:59.580297 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:54:59.692017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:59.702412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-08b9dc25-54ae-4dae-9553-71974f9eb107 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.183821 Jul 29 12:54:59.703270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 312/645] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:59 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:54:59.811312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:54:59.819438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-54d77aa5-30df-4135-aad4-b74c58de169d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.258480 Jul 29 12:54:59.820018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 334/646] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:54:59 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:00.107229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:00.107878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:00.114065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.114526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.115292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.115745 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.180739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:00.181382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:00.183662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:00.189371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.190427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.191214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.191823 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.248355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:00.256373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:00.257946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:00.259049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1ad470c1-468a-4e2c-ac20-053606dc6b33 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.155784 Jul 29 12:55:00.259609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 313/647] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:00 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:00.325762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:00.333248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c4686696-592f-4e57-ab55-6aa9e73cc80a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.157084 Jul 29 12:55:00.333837 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 335/648] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:00 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:00.724505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:00.725144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:00.731608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.732053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.732801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.733235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.840498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:00.841504 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:00.848274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.848733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.849540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:00.850054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:00.879288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:00.887831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bd3b9f04-26df-446f-83ca-0d69e35bd2aa tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.167707 Jul 29 12:55:00.888405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 314/649] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:00 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:00.981277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:00.988777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cca0447f-f2fa-4fae-bfcb-27fbadd52912 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.152172 Jul 29 12:55:00.989343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 336/650] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:00 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:01.282358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:01.283106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:01.289768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.290260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.291041 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.291486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.357648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:01.358515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:01.366645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.367359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.368822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.369901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.450099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:01.458848 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:01.460584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:01.461706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-84814b55-c78b-438a-80aa-b177d14b29b8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.183309 Jul 29 12:55:01.462842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 315/651] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:01 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:01.838861 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:01.846490 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e3e79de6-15a9-4d51-b358-fd3d1dd48fcc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.493934 Jul 29 12:55:01.847056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 337/652] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:01 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:01.909678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:01.910406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:01.916811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.917264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.918138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.918581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.947133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-46962b54-d64c-4da5-adae-394fee22b7ca req-de0e1701-cc6f-4277-841e-348fc22ff7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:01.963181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-46962b54-d64c-4da5-adae-394fee22b7ca req-de0e1701-cc6f-4277-841e-348fc22ff7d9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:01.963627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-46962b54-d64c-4da5-adae-394fee22b7ca req-de0e1701-cc6f-4277-841e-348fc22ff7d9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:01.977216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-46962b54-d64c-4da5-adae-394fee22b7ca req-de0e1701-cc6f-4277-841e-348fc22ff7d9 service nova] Creating event network-changed:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:55:01.982238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-46962b54-d64c-4da5-adae-394fee22b7ca req-de0e1701-cc6f-4277-841e-348fc22ff7d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039277 Jul 29 12:55:01.983288 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 338/653] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:55:02.011216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:02.012137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:02.019239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:02.019838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:02.020866 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:02.021547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:02.103160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:02.120531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6586e47d-b1f7-42cf-86c3-34241010b08c tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.214669 Jul 29 12:55:02.124692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 316/654] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:01 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:02.220188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:02.230226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3a38dcc3-baf8-4342-9600-df3d77a87c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.223277 Jul 29 12:55:02.231142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 339/655] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:02 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:02.484654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:02.485265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:02.492537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:02.493003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:02.493786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:02.494251 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:02.624558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:02.632839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:02.634494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:02.635689 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1fb31b4c-117e-49cb-b9b2-9179afd840fe tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.154935 Jul 29 12:55:02.636335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 317/656] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:02 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:02.868959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:02.869635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:02.877171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:02.877625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:02.878419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:02.878893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.011628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.019237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7a906470-5c79-4512-a793-803601ec20d7 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1510 microversion: 2.1 time: 0.155021 Jul 29 12:55:03.019810 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 340/657] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:02 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:03.040972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:03.041574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:03.050889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.051573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.052963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.053783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.060625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:03.103304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129323) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 12:55:03.144750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:03.145890 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:03.152965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.153419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.154209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.154648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.170635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-605cafd2-7912-49fe-9da4-a6ca1473da30 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "POST /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.133719 Jul 29 12:55:03.171341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 318/658] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:55:03 2022] POST /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:55:03.179126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:03.179866 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:03.186668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.187247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.188082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.188576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.327736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.335549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ff508bd6-4af4-4bc1-ab09-da86cb61fab5 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1518 microversion: 2.1 time: 0.160193 Jul 29 12:55:03.336114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 319/659] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:03 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:03.340948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:03.341546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:03.348092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.348600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.349452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.350412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.389797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.397758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c9e44d57-6ca5-4ddc-ac65-6f8ac6209957 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.256828 Jul 29 12:55:03.398605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 341/660] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:03 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:03.481158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.489558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-54e95df9-e184-4229-84c8-d318fa19b2f7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1676 microversion: 2.1 time: 0.152473 Jul 29 12:55:03.491048 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 320/661] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:03 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:03.658472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:03.659074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:03.665117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.665563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.666345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:03.666781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:03.802319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.808194 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:03.812292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.813908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:03.814995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c251d5da-b0b8-4086-a4ad-1cb6aa3a4610 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.160463 Jul 29 12:55:03.815584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 342/662] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:03 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:04.357151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:04.357853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:04.364604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.365068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.365846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.366283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.419240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:04.419764 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:04.427057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.427555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.428323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.428884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.508528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:04.516247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1ae55ecc-dac7-48a1-ad45-b68fe0310d73 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1518 microversion: 2.1 time: 0.163399 Jul 29 12:55:04.516825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 321/663] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:04 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:04.521449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:04.522122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:04.528271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.528742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.529559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.530034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.591714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:04.601106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-df72f752-096f-464a-95de-d6786e8b53e0 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.186060 Jul 29 12:55:04.601852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 343/664] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:04 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:04.666716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:04.674143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a8ce1f91-e12c-4665-bda5-e22cabb70cec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1653 microversion: 2.1 time: 0.156286 Jul 29 12:55:04.674641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 322/665] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:04 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:04.695816 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-30d2f3cb-ad88-4168-b503-609368128df7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:04.702928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-30d2f3cb-ad88-4168-b503-609368128df7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.703740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-30d2f3cb-ad88-4168-b503-609368128df7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.730940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-30d2f3cb-ad88-4168-b503-609368128df7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Going to try to start instance {{(pid=129324) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 12:55:04.774857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-30d2f3cb-ad88-4168-b503-609368128df7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action" status: 202 len: 0 microversion: 2.1 time: 0.083060 Jul 29 12:55:04.775962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 344/666] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:55:04 2022] POST /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:55:04.784558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:04.785263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:04.791629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.792095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.792919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.793358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.838579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:04.839191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:04.845390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.845864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.846895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:04.847331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:04.940849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:04.949970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b773f2ad-abd3-49d4-bbcc-288d04366144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1662 microversion: 2.1 time: 0.169486 Jul 29 12:55:04.950546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 323/667] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:04 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:05.049022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:05.062312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:05.063914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:05.065173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3c48d031-015c-4374-82e1-9ef61b54fe78 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.230861 Jul 29 12:55:05.065959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 345/668] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:04 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:55:05.536748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:05.537303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:05.546011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:05.547540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:05.548348 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:05.548793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:05.623457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:05.624067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:05.632553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:05.633265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:05.634321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:05.634956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:05.798062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:05.809918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e9de3c2d-570e-4de0-a0e9-a8ed2737f737 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.276992 Jul 29 12:55:05.810632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 324/669] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:05 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:05.883377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:05.897691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a26737d2-3ff7-4bfb-b92b-bd074ac7f90b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.277987 Jul 29 12:55:05.900185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 346/670] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:05 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:05.972756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:05.973549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:05.981064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:05.981521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:05.982438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:05.982897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.089106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:06.091180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:06.098314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.098760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.100550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.102233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.187391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:06.195614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ba9fb3e4-35a7-41c3-96ae-605026d2f1d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1662 microversion: 2.1 time: 0.226937 Jul 29 12:55:06.211331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 325/671] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:05 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1662 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:06.266850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-28764e4c-a094-4859-925e-a34445314cba req-5fd32d6c-22da-436d-a666-0bb00d1a9107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "name": "network-vif-unplugged", "status": "completed", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:06.278837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:06.280493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:06.288819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-28764e4c-a094-4859-925e-a34445314cba req-5fd32d6c-22da-436d-a666-0bb00d1a9107 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.288819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-28764e4c-a094-4859-925e-a34445314cba req-5fd32d6c-22da-436d-a666-0bb00d1a9107 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.295165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:06.297023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:06.300651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-40d01d79-1c7e-4a30-9824-94fd118e8a7f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.212980 Jul 29 12:55:06.302516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 347/672] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:06 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:06.326469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-28764e4c-a094-4859-925e-a34445314cba req-5fd32d6c-22da-436d-a666-0bb00d1a9107 service nova] Creating event network-vif-unplugged:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:55:06.332935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-28764e4c-a094-4859-925e-a34445314cba req-5fd32d6c-22da-436d-a666-0bb00d1a9107 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074128 Jul 29 12:55:06.339817 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 326/673] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:06.833426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:06.834171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:06.842231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.842411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.843176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.843612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.924285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:06.925363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:06.933019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.934501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.935308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:06.936098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:06.987213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:06.996328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-08455207-cbaf-4caf-ae5e-afe927d0f2d8 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.166660 Jul 29 12:55:07.010450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 348/674] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:06 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:07.147622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:07.155571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-684ae1ba-61fe-4b73-b9f2-d18797c91228 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.237172 Jul 29 12:55:07.156130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 327/675] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:06 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:07.219322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:07.219933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:07.226773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:07.227222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:07.227977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:07.228418 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:07.326693 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:07.327303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:07.333481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:07.333971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:07.334743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:07.335187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:07.357133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:07.364697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6bb17cdf-b5c0-46d0-bb7d-682f7491016d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1666 microversion: 2.1 time: 0.149194 Jul 29 12:55:07.373877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 349/676] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:07 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:07.466635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:07.475351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:07.476845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:07.477963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6361397b-5c6c-4678-adc0-fc5b662a8a3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.155116 Jul 29 12:55:07.478519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 328/677] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:07 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:55:08.019946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:08.020464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:08.027731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.028177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.028945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.029358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.166866 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:08.175836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1f9e6674-4343-44ba-9921-77481d23995a tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.159670 Jul 29 12:55:08.176497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:08.177114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:08.179300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:08.180844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=12 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:08.187449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.187889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.188655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.189149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.191786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 350/678] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:08 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:08.333357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:08.341367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-62796d34-a3c6-455e-809b-90be1fbd16e6 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.169130 Jul 29 12:55:08.341971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 329/679] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:08 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:08.375219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-9de73bf7-53c5-431d-8b46-0832201f274a req-d3a7f0d5-088a-4856-98e5-790f0d633af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "name": "network-vif-plugged", "status": "completed", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:08.385157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-9de73bf7-53c5-431d-8b46-0832201f274a req-d3a7f0d5-088a-4856-98e5-790f0d633af3 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.385598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-9de73bf7-53c5-431d-8b46-0832201f274a req-d3a7f0d5-088a-4856-98e5-790f0d633af3 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.395998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-9de73bf7-53c5-431d-8b46-0832201f274a req-d3a7f0d5-088a-4856-98e5-790f0d633af3 service nova] Creating event network-vif-plugged:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:55:08.400658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-9de73bf7-53c5-431d-8b46-0832201f274a req-d3a7f0d5-088a-4856-98e5-790f0d633af3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029037 Jul 29 12:55:08.401192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 351/680] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:08.501634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:08.502323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:08.510539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.510750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.511485 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:08.511942 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:08.701324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:08.709287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:08.710854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:08.711951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fa4c46a0-3409-4171-8a39-b9e9374f2e32 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.215233 Jul 29 12:55:08.712511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 330/681] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:08 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:09.199063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:09.199757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:09.206057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:09.206508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:09.207263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:09.207701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:09.336636 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:09.344267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-801cb71e-f84a-4d4b-a727-f8edbf602e77 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.149875 Jul 29 12:55:09.344829 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 352/682] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:09 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:09.362581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:09.363196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:09.369655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:09.370144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:09.370912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:09.371356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:09.517359 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:09.526035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-075713e4-2039-457b-b651-a49896238939 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1755 microversion: 2.1 time: 0.167240 Jul 29 12:55:09.526587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 331/683] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:09 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:09.735595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:09.736157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:09.742127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:09.742578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:09.743345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:09.743779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:09.874116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:09.882090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:09.883583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:09.884671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-22a66955-a18a-42fc-920e-078d5694f9f1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1407 microversion: 2.20 time: 0.153134 Jul 29 12:55:09.885231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 353/684] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:09 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:10.367293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:10.368493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:10.378295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:10.378720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:10.379527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:10.379971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:10.520592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:10.530586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0b9c2502-0e2d-45ff-bd60-de229984e441 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.168572 Jul 29 12:55:10.531203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 332/685] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:10 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:10.547335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:10.547966 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:10.554613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:10.555061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:10.555814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:10.556416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:10.703680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:10.713041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-43adb200-a38a-44f3-bb76-8d83bbd7ea9f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1758 microversion: 2.1 time: 0.169640 Jul 29 12:55:10.713611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 354/686] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:10 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:10.908552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:10.909065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:10.915080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:10.915540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:10.916307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:10.916751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:11.045102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:11.053635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:11.055246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:11.056392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-77df46fa-a1eb-424f-bf81-febaa857db4a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1599 microversion: 2.20 time: 0.151884 Jul 29 12:55:11.056954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 333/687] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:55:10 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:55:11.078615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:11.079109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:11.085635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:11.086113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:11.086880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:11.087314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:11.164899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-50ddce1f-23eb-4f45-8bfc-35e6cd1d5d53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090113 Jul 29 12:55:11.165501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 355/688] 10.222.0.66 () {60 vars in 1316 bytes} [Fri Jul 29 12:55:11 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:55:11.554612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:11.555210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:11.561671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:11.562169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:11.562944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:11.563379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:11.582098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:11.702857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:11.714672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a6fa6ca3-2ae9-4a6c-b061-c23609fa54ef tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.164376 Jul 29 12:55:11.715268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 334/689] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:11 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:12.336048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-03a90925-a1e5-427a-aa85-2398aebc7672 req-f9cacdd2-c47c-4642-86a9-d942ec35b9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:12.345729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-03a90925-a1e5-427a-aa85-2398aebc7672 req-f9cacdd2-c47c-4642-86a9-d942ec35b9bb service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:12.346452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-03a90925-a1e5-427a-aa85-2398aebc7672 req-f9cacdd2-c47c-4642-86a9-d942ec35b9bb service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:12.358429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-03a90925-a1e5-427a-aa85-2398aebc7672 req-f9cacdd2-c47c-4642-86a9-d942ec35b9bb service nova] Creating event network-changed:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:55:12.363290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-03a90925-a1e5-427a-aa85-2398aebc7672 req-f9cacdd2-c47c-4642-86a9-d942ec35b9bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032427 Jul 29 12:55:12.363880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 356/690] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:12.736845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:12.737380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:12.744497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:12.744949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:12.745723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:12.746192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:12.928846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:12.936495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-22e7075c-37e3-42a6-91ce-d180a0a84560 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.204014 Jul 29 12:55:12.937078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 335/691] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:12 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:13.959498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:13.960121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:13.966313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:13.966762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:13.967524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:13.967962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:14.158350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:14.166305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bec36b3b-c1b6-46e1-97bf-85be93ce9dae tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1576 microversion: 2.1 time: 0.212295 Jul 29 12:55:14.166844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 357/692] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:13 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:15.187753 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:15.188478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:15.195759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:15.196224 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:15.196992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:15.197435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:15.326616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:15.334106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cf31d0b7-476e-4e4e-a111-0d9953d86c35 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1563 microversion: 2.1 time: 0.150209 Jul 29 12:55:15.334663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 336/693] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:15 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:18.268979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-6b5a45c1-0751-4b21-8966-e0cb03cf6349 req-ceb42ed0-8bcf-4fbd-a9f7-baf006d2ee30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "name": "network-vif-plugged", "status": "completed", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:18.279902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-6b5a45c1-0751-4b21-8966-e0cb03cf6349 req-ceb42ed0-8bcf-4fbd-a9f7-baf006d2ee30 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:18.280349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-6b5a45c1-0751-4b21-8966-e0cb03cf6349 req-ceb42ed0-8bcf-4fbd-a9f7-baf006d2ee30 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:18.291631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-6b5a45c1-0751-4b21-8966-e0cb03cf6349 req-ceb42ed0-8bcf-4fbd-a9f7-baf006d2ee30 service nova] Creating event network-vif-plugged:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:55:18.296574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-6b5a45c1-0751-4b21-8966-e0cb03cf6349 req-ceb42ed0-8bcf-4fbd-a9f7-baf006d2ee30 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031451 Jul 29 12:55:18.297159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 358/694] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:23.083115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:23.084166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:23.090920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:23.091365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:23.092124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:23.092558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:23.115419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b5927e7d-27af-4af8-a6c4-15a2a2c06fe6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/ips" status: 200 len: 150 microversion: 2.1 time: 0.036199 Jul 29 12:55:23.115994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 337/695] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:55:23 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:24.446475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a947e3fe-41aa-4460-a2c0-5a6640c1a7cc"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:24.448959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:24.455224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:24.455681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:24.456439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:24.456879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:24.694923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:24.713233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-edfcda8e-d687-4517-a691-a4eae76028a6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271817 Jul 29 12:55:24.713865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 359/696] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:55:24 2022] POST /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:28.103467 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:55:28.104088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 12:55:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 12:55:32.219956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:32.220453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:32.227682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.228136 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.228905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.229345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.318015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lazy-loading 'services' on Instance uuid 04a714f7-cb41-49d2-a3d9-548b76a88ff0 {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:55:32.330416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a947e3fe-41aa-4460-a2c0-5a6640c1a7cc"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:32.332764 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:32.335142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=50 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:32.341307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.341754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.342549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.342976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.387667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bb92937f-be7c-4104-a284-bc705771fab5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments/bf73bc5c-989f-4e67-ac96-cbef0d3d4a43" status: 202 len: 0 microversion: 2.1 time: 0.171559 Jul 29 12:55:32.391592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 338/697] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:55:32 2022] DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments/bf73bc5c-989f-4e67-ac96-cbef0d3d4a43 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:55:32.398930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:32.401307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:32.408300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.408896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.409912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.410453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.433082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Invalid volume: volume a947e3fe-41aa-4460-a2c0-5a6640c1a7cc is already attached to instances: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: POST /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments HTTP/1.1 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 74 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:55:32.434808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {"volumeAttachment": {"volumeId": "a947e3fe-41aa-4460-a2c0-5a6640c1a7cc"}} Jul 29 12:55:32.436437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Invalid volume: volume a947e3fe-41aa-4460-a2c0-5a6640c1a7cc is already attached to instances: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'server_id': '2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9', 'body': {'volumeAttachment': {'volumeId': 'a947e3fe-41aa-4460-a2c0-5a6640c1a7cc'}}} Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a947e3fe-41aa-4460-a2c0-5a6640c1a7cc is already attached to instances: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:32.437262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a947e3fe-41aa-4460-a2c0-5a6640c1a7cc is already attached to instances: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:32.438639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a947e3fe-41aa-4460-a2c0-5a6640c1a7cc is already attached to instances: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 400 to user: Invalid volume: volume a947e3fe-41aa-4460-a2c0-5a6640c1a7cc is already attached to instances: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f74e6214-7c5f-48e7-b6e8-1727fb86cb69 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110678 Jul 29 12:55:32.439808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 360/698] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:55:32 2022] POST /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 29 12:55:32.451096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5f9ceb7b-2e67-4657-aaad-e58513d268fc tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058052 Jul 29 12:55:32.451679 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 339/699] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:55:32 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:32.506115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:32.506656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:32.514295 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.514746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.515530 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.515993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.593807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lazy-loading 'services' on Instance uuid 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:55:32.671109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fa7b07ef-0303-4c5b-a48f-e3a3bb055422 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments/a947e3fe-41aa-4460-a2c0-5a6640c1a7cc" status: 202 len: 0 microversion: 2.1 time: 0.169192 Jul 29 12:55:32.671684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 361/700] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:55:32 2022] DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments/a947e3fe-41aa-4460-a2c0-5a6640c1a7cc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:55:32.680782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:32.682950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:32.688895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.689338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.690163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:32.690595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:32.719786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-24706010-7f02-437e-a0bf-61cc7a235328 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Jul 29 12:55:32.720349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 340/701] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:55:32 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:33.465344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:33.467651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:33.474259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:33.474704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:33.475452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:33.475882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:33.503436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-479ad7b6-1c1a-40c9-a1f8-c578a9bd26f8 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Jul 29 12:55:33.503958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 362/702] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:55:33 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:33.731999 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:33.734108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:33.740714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:33.741160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:33.741949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:33.742390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:33.774529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3d0f174c-1584-49b7-8866-45e8a55c58c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Jul 29 12:55:33.775105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 341/703] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:55:33 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:34.515543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:34.517608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:34.525502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.525984 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.526750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.527189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.556104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0a281233-53a1-4d8c-8efd-d767a4414728 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044578 Jul 29 12:55:34.556649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 363/704] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:55:34 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:55:34.632113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:34.632680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:34.638950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.639408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.640179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.640617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.664482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:55:34.738961 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9f005631-0de2-4d5c-8265-013e5026b228 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 204 len: 0 microversion: 2.1 time: 0.111105 Jul 29 12:55:34.742943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 342/705] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:55:34 2022] DELETE /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:55:34.748077 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:34.748838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:34.755762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.756218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.756982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.757423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.786892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:34.789087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:34.795234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.795687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.796469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.796905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.826322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dc31e59d-5fed-4fb6-8d92-cafb2cf3c256 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043809 Jul 29 12:55:34.826925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 343/706] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:55:34 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 12:55:34.886754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:34.888723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:34.889292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:34.894417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6cba462e-d8c6-4fae-b25b-34394f7d0a7c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.150255 Jul 29 12:55:34.895263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 364/707] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:34 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:34.896964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.897458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.898280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:34.898727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:34.924450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:55:34.994931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a4c817e2-638f-4866-86cc-852e9e486b52 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 204 len: 0 microversion: 2.1 time: 0.109786 Jul 29 12:55:34.995498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 344/708] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:55:34 2022] DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 12:55:35.003513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:35.004131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:35.010980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:35.011491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:35.012254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:35.012695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:35.151014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:35.158697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-af7cc1fc-d610-43ad-9f1a-df44abec6ba1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.158969 Jul 29 12:55:35.159498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 365/709] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:34 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:35.916464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:35.917166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:35.923648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:35.924108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:35.924874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:35.925342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.057222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:36.064749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3f3d9372-8b93-406f-afae-d54b01d19dd9 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.152533 Jul 29 12:55:36.065321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 345/710] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:35 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:36.081285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:36.081945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:36.090904 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:36.091693 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.092485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:36.092926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.119541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:55:36.181179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:36.181890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:36.188083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:36.188538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.189307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:36.189748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.194486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-50b701d5-e964-415a-b314-564fabf62008 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 204 len: 0 microversion: 2.1 time: 0.116371 Jul 29 12:55:36.194680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 366/711] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:55:36 2022] DELETE /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:55:36.202724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:36.203415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:36.209220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:36.209666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.210446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:36.210878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:36.320104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:36.327623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2acc2b96-e837-4d0a-b060-a740f3867914 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.151612 Jul 29 12:55:36.328195 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 346/712] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:36 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:36.346601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:36.356108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b5910ee8-d705-4dde-b38f-f633369c086c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.157226 Jul 29 12:55:36.356701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 367/713] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:36 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:37.087420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:37.088019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:37.090412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:37.096125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:37.096844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:37.097597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:37.098061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:37.122423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:37.234198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:37.242156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7fa5aeca-6426-4b87-bae9-de6042d8007d tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.159211 Jul 29 12:55:37.242731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 347/714] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:37 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:37.349143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:37.349726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:37.356185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:37.356637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:37.357403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:37.357868 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:37.378126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:37.378732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:37.384575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:37.385022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:37.385810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:37.386897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:37.487983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:37.495572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-78927395-e39a-418f-9386-86a05fb48907 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.151005 Jul 29 12:55:37.496143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 368/715] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:37 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:37.517758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:37.525722 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e335a3bd-c59f-41b4-8d43-1aabb0767010 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.151403 Jul 29 12:55:37.526328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 348/716] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:37 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:38.262785 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:38.263417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:38.269997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:38.270492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:38.271249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:38.271680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:38.403206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:38.410662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-df5c3193-b2ce-44fb-a0cf-a3f9083e30df tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.151681 Jul 29 12:55:38.411230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 369/717] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:38 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:38.517704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:38.518333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:38.524915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:38.525360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:38.526164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:38.526597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:38.549115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:38.550125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:38.556684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:38.557141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:38.558007 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:38.561883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:38.657039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:38.665202 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fbe11f46-3518-4373-a4c8-3002bcb49418 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.151332 Jul 29 12:55:38.665781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 349/718] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:38 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:38.695665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:38.703252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-34565f93-92b8-4be1-aef8-3ff30a75dbfc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.159746 Jul 29 12:55:38.703823 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 370/719] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:38 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:39.432673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:39.433275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:39.439393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:39.439840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:39.440591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:39.441025 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:39.571317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:39.578725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3adf434b-81ee-4457-85a9-f0dc32889509 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.149843 Jul 29 12:55:39.579295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 350/720] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:39 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:39.685611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:39.686180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:39.692570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:39.693011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:39.693759 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:39.694211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:39.725232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:39.725985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:39.732083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:39.732613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:39.733456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:39.734024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:39.828698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:39.836674 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5255176d-7f37-4cc0-b253-d0bc8f80e686 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.154907 Jul 29 12:55:39.837245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 371/721] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:39 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:39.865374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:39.872799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ab8461cb-53a8-4a1d-bb91-1ad1dfcd847e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.152238 Jul 29 12:55:39.873362 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 351/722] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:39 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:40.599960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:40.600572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:40.606623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:40.607079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:40.607841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:40.608279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:40.736776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:40.744743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-296141b0-8f45-493a-a2ea-835e3b004482 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.148940 Jul 29 12:55:40.745312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 372/723] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:40 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:40.858953 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:40.859527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:40.866625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:40.867078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:40.867844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:40.868285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:40.893165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:40.893912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:40.900946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:40.901416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:40.902198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:40.902635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:41.000738 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:41.009376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9f37218f-678d-404f-82b7-f60e057e2a59 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.154591 Jul 29 12:55:41.009985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 352/724] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:40 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:41.042290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:41.045781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:41.050858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f3e9c4b7-036e-4aa6-8868-d4218e5e9734 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.161533 Jul 29 12:55:41.051419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 373/725] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:40 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:41.766094 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:41.766706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:41.773322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:41.773771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:41.774559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:41.774998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:41.902498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:41.909994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-74d4906a-872a-4d9d-896d-81a4f445f5d4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.147783 Jul 29 12:55:41.910558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 353/726] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:41 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:42.031463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:42.032117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:42.040715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:42.041174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:42.042174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:42.042617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:42.072444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:42.073091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:42.079113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:42.079562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:42.080357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:42.080796 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:42.184389 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:42.192009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-761f75ed-3946-4f03-99e1-7bec7af62a45 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1680 microversion: 2.1 time: 0.164494 Jul 29 12:55:42.192609 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 374/727] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:42 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:42.229795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:42.237221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-44eb1980-6444-4fb5-97d2-17105f7bcd46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.168541 Jul 29 12:55:42.237788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 354/728] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:42 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:42.931663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:42.932279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:42.938637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:42.939095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:42.939865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:42.940309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:43.157320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:43.165366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-559c384c-5d88-4cf3-98eb-f9af9974e9d6 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1689 microversion: 2.1 time: 0.237616 Jul 29 12:55:43.166781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 375/729] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:42 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:43.215133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:43.216054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:43.225703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:43.226366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:43.227315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:43.229235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:43.259007 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:43.259898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:43.266970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:43.267778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:43.268829 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:43.269419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:43.336749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:43.344189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8796d43e-e32e-410b-a50d-eec5e7eead55 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1614 microversion: 2.1 time: 0.134792 Jul 29 12:55:43.344760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 355/730] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:43 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1614 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:43.496059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:43.506978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-82ed2e67-9f42-40e3-8240-cad3fe00ee78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1575 microversion: 2.1 time: 0.252602 Jul 29 12:55:43.507983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 376/731] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:43 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:43.659860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-b8405af5-1201-4a21-9bb8-79e166df7506 req-4d822ef0-fa72-468b-a0e5-1d8a695f44b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9", "name": "network-vif-deleted", "tag": "d81dc7a5-0481-4a46-b518-0038f49493f5"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:43.694776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-b8405af5-1201-4a21-9bb8-79e166df7506 req-4d822ef0-fa72-468b-a0e5-1d8a695f44b0 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:43.695370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-b8405af5-1201-4a21-9bb8-79e166df7506 req-4d822ef0-fa72-468b-a0e5-1d8a695f44b0 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:43.735739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-b8405af5-1201-4a21-9bb8-79e166df7506 req-4d822ef0-fa72-468b-a0e5-1d8a695f44b0 service nova] Creating event network-vif-deleted:d81dc7a5-0481-4a46-b518-0038f49493f5 for instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 on hv-cinder-81914 Jul 29 12:55:43.747841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-b8405af5-1201-4a21-9bb8-79e166df7506 req-4d822ef0-fa72-468b-a0e5-1d8a695f44b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093392 Jul 29 12:55:43.751031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 356/732] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:44.208867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:44.210716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:44.237346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.249505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-f6ae00bd-c681-43b7-9b32-c2a76a2dc54c req-6034dc78-0c16-4cb0-8888-4e553023462b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a714f7-cb41-49d2-a3d9-548b76a88ff0", "name": "network-vif-deleted", "tag": "554bff31-bbb8-4e37-b051-7ae3996fa046"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:44.259815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.264018 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.265882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.290714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f6ae00bd-c681-43b7-9b32-c2a76a2dc54c req-6034dc78-0c16-4cb0-8888-4e553023462b service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.294994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f6ae00bd-c681-43b7-9b32-c2a76a2dc54c req-6034dc78-0c16-4cb0-8888-4e553023462b service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.344529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-f6ae00bd-c681-43b7-9b32-c2a76a2dc54c req-6034dc78-0c16-4cb0-8888-4e553023462b service nova] Creating event network-vif-deleted:554bff31-bbb8-4e37-b051-7ae3996fa046 for instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 on hv-cinder-81914 Jul 29 12:55:44.351591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-f6ae00bd-c681-43b7-9b32-c2a76a2dc54c req-6034dc78-0c16-4cb0-8888-4e553023462b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253950 Jul 29 12:55:44.353078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 377/733] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:44.370172 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:44.370968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:44.378045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.378991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.379875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.380412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.427774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.429266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.430186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lazy-loading 'fault' on Instance uuid 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:55:44.442394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:44.455925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ce01d70a-6f19-40d6-9244-4ab613762ef5 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 200 len: 1329 microversion: 2.1 time: 0.271218 Jul 29 12:55:44.470238 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 357/734] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:44 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 1329 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:44.493144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:44.503423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b5716c39-9ae7-44d1-849c-bd59ce8e90c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 200 len: 1331 microversion: 2.1 time: 0.140076 Jul 29 12:55:44.505073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 378/735] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:44 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:44.529366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:44.530009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:44.537063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.537518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.538320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:44.538965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:44.611341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:44.619835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4d216730-88c4-4245-acfd-aaa48451478b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 200 len: 1224 microversion: 2.1 time: 0.094254 Jul 29 12:55:44.620654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 358/736] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:44 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:45.476962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:45.477698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: 04a714f7-cb41-49d2-a3d9-548b76a88ff0] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:45.484432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:45.484957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:45.485798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:45.486540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:45.500439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] HTTP exception thrown: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 could not be found. Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Request method failure captured: Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 HTTP/1.1 Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eRa0q_DgInPevO1z84sH37ZI1Mvwr4czUglHFjXqXy7ltot0wnWU-IMbqJJ8NCi6rhIv8kM5Zk0N56Yf4tNk_aGZOt3sNgq46u91ql66RqyLU0QJZAJW1ZRzBtmEOHfuWdq_RCTt69PavK-gC4ddGmgJLnO60JNEZCVPEwnfStPcI Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:55:45.502497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 1dd24e8c0d214a0bb62578f9834a40a2 Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 could not be found. Jul 29 12:55:45.503985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '04a714f7-cb41-49d2-a3d9-548b76a88ff0'} Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 could not be found. Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:55:45.505480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 could not be found. Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 could not be found. Jul 29 12:55:45.507066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.508526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Returning 404 to user: Instance 04a714f7-cb41-49d2-a3d9-548b76a88ff0 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:55:45.508526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4283c514-6dfa-4e9d-8cb5-40e58f618a05 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0" status: 404 len: 111 microversion: 2.1 time: 0.031445 Jul 29 12:55:45.508526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 379/737] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:45 2022] GET /compute/v2.1/servers/04a714f7-cb41-49d2-a3d9-548b76a88ff0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:55:45.515549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9b6eb0d3-ada1-4540-a3ee-fc1ddb53d84f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '.version_select at 0x7f74a1e6bca0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:45.529008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:45.529979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:45.538659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:45.538904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9b6eb0d3-ada1-4540-a3ee-fc1ddb53d84f tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469386203" status: 202 len: 0 microversion: 2.1 time: 0.027330 Jul 29 12:55:45.539587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:45.542735 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 359/738] 10.222.0.66 () {58 vars in 1218 bytes} [Fri Jul 29 12:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469386203 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:55:45.544374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:45.544988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:45.560771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 HTTP/1.1 Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:55:45.562710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:55:45.564040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9'} Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:55:45.564778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:55:45.565999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.569537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:55:45.570626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-421aad62-5512-445b-a83b-3225f0038b79 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 404 len: 111 microversion: 2.1 time: 0.046337 Jul 29 12:55:45.573958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 380/739] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:45 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:55:45.582328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-62300fc8-149a-46a3-9942-dd4e8cf9b2c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '.version_select at 0x7f74a1decee0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:45.611108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-62300fc8-149a-46a3-9942-dd4e8cf9b2c3 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010643937" status: 202 len: 0 microversion: 2.1 time: 0.033728 Jul 29 12:55:45.613874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 360/740] 10.222.0.66 () {58 vars in 1221 bytes} [Fri Jul 29 12:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010643937 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:55:45.641104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:45.642112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:45.649425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:45.650008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:45.650903 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:45.651408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:45.667585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] HTTP exception thrown: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Request method failure captured: Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 HTTP/1.1 Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49f894tvKSHihyCeOq_KQBrslE1ACweZOlyaaQCoo4XP8PQhViDhHeD6mza-k5mc92D1pZGPT4gUATH7fHWLGw_89id3vT1bDsK4QcXruYvn-b1XIr2iD1m5jEwt0T4X0rNpDs1HkdEH_UjcP4xaNCPfnaumFJvCayPCa2VbMdq3zJY Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 15f411d81f95464389c9ea3c12cee88d Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-TestVolumeBootPattern-1639178603 Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:55:45.669431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-TestVolumeBootPattern-1639178603 Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 15f411d81f95464389c9ea3c12cee88d Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-TestVolumeBootPattern-1639178603 Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-TestVolumeBootPattern-1639178603-project Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 07220936c8784339b62f22482264e234 Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-TestVolumeBootPattern-1639178603-project Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 12:55:45.670813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '0e77e87a-7f63-4eb0-9357-1e907bb5cf68'} Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:55:45.671783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 12:55:45.673161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:55:45.675336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Returning 404 to user: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:55:45.675336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-061fced3-e749-4c04-b0ed-9ca10751e494 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 404 len: 111 microversion: 2.1 time: 0.033731 Jul 29 12:55:45.675336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 381/741] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:45 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:55:45.822060 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-84719352", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-887022515", "security_groups": [{"name": "tempest-secgroup-smoke-967962281"}], "block_device_mapping_v2": [{"uuid": "c6629e0e-b8d6-4070-afe8-6481e55d4283", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0f4a2881-36c5-4430-8c99-da426c4cf08a"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:46.302635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] validate_networks() for [('0f4a2881-36c5-4430-8c99-da426c4cf08a', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:55:46.368272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-72239ad7-8d37-47f1-8168-2d4b8c7f7aca req-f98b8385-6aec-490a-ac21-43575e103ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e77e87a-7f63-4eb0-9357-1e907bb5cf68", "name": "network-vif-deleted", "tag": "832e8a04-76aa-4ddd-a3f4-44fbaa7755b3"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:46.379993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-72239ad7-8d37-47f1-8168-2d4b8c7f7aca req-f98b8385-6aec-490a-ac21-43575e103ce9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:46.380737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-72239ad7-8d37-47f1-8168-2d4b8c7f7aca req-f98b8385-6aec-490a-ac21-43575e103ce9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:46.391704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-72239ad7-8d37-47f1-8168-2d4b8c7f7aca req-f98b8385-6aec-490a-ac21-43575e103ce9 service nova] Creating event network-vif-deleted:832e8a04-76aa-4ddd-a3f4-44fbaa7755b3 for instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 on hv-cinder-81914 Jul 29 12:55:46.396970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-72239ad7-8d37-47f1-8168-2d4b8c7f7aca req-f98b8385-6aec-490a-ac21-43575e103ce9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032350 Jul 29 12:55:46.397741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 382/742] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:55:46.877460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d1420e80-050b-45c9-9576-bdc15d76705b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: .version_select at 0x7f74a1eb6790>, body: {"keypair": {"name": "tempest-keypair-986082360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi9O+lhZi/iKtLVtBKwHNfDsAOU4xPkJlcs2S+i2U7AN2oJJ5zuzdG95mqNL6ZHRMKRLnyy+guKSEycLTSijzyRmTfiJRbzMkK0ibawxk4lvaB2LqZQRJ4UEs8UvRLmwg=="}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:46.892773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-d1420e80-050b-45c9-9576-bdc15d76705b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:55:46.896679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.quota [None req-d1420e80-050b-45c9-9576-bdc15d76705b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'key_pairs'} {{(pid=129324) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:55:46.919482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d1420e80-050b-45c9-9576-bdc15d76705b tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046627 Jul 29 12:55:46.920335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 383/743] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:55:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:55:46.950419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:55:46.951091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:55:46.951358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:55:46.951810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:55:46.952284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:55:46.961111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:46.961566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:46.962402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:46.963112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:46.980525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Getting quotas for project 15f411d81f95464389c9ea3c12cee88d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:55:46.984250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Getting quotas for user 07220936c8784339b62f22482264e234 and project 15f411d81f95464389c9ea3c12cee88d. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:55:47.045024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:55:47.047682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6629e0e-b8d6-4070-afe8-6481e55d4283',volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:55:47.196185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a238057d-e7d2-4bae-b4b9-8798f381f754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.377879 Jul 29 12:55:47.197246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 361/744] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:55:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:55:47.209783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d90bd83e-1a3b-4b8b-a2d9-86bfed4f01a8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:47.209783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d90bd83e-1a3b-4b8b-a2d9-86bfed4f01a8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:47.272418 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d90bd83e-1a3b-4b8b-a2d9-86bfed4f01a8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:47.279975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d90bd83e-1a3b-4b8b-a2d9-86bfed4f01a8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1092 microversion: 2.1 time: 0.075941 Jul 29 12:55:47.289479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 384/745] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:47 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1092 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:48.274587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1887883309", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3"}], "security_groups": [{"name": "tempest-securitygroup--1436652502"}], "key_name": "tempest-keypair-986082360", "user_data": "}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:48.301285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:48.302015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:48.309973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:48.310440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:48.311223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:48.311842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:48.386076 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:48.407530 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-05be7b8e-c10a-4e6d-aa23-0aec38add6ec tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1198 microversion: 2.1 time: 0.110557 Jul 29 12:55:48.408256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 385/746] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:48 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:48.445943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] validate_networks() for [('2e0e4d0c-3003-476d-8c71-c5dd0e62c2f3', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:55:48.544633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:48.545215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:48.551505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:48.551953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:48.552741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:48.553178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:48.577887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:55:48.655879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6eb534c3-7593-49ae-a58e-0438fbfe5e61 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 204 len: 0 microversion: 2.1 time: 0.114949 Jul 29 12:55:48.656477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 386/747] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:55:48 2022] DELETE /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 12:55:48.665610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:48.666624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:48.674514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:48.675004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:48.675752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:48.676189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:48.826525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:48.834347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7fabb8da-e6dd-401f-b848-f9315f05c981 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1508 microversion: 2.1 time: 0.173640 Jul 29 12:55:48.834916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 387/748] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:48 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:49.123499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:55:49.124156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:55:49.124638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:55:49.125115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:55:49.125466 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:55:49.134624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:49.135074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:49.135872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:49.136311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:49.153298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:55:49.157057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Getting quotas for user b4d57a4e83ab4310b5b3ba90f43c5ddc and project d57fc58eac4149e780e4329e87582260. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:55:49.167923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:55:49.170059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:55:49.221609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0051adf4-8763-4376-8680-a097517a2298 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.950677 Jul 29 12:55:49.221609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 362/749] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:55:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:55:49.231968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cfda330d-2176-41e8-832c-7938ced53460 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:49.232591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cfda330d-2176-41e8-832c-7938ced53460 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:49.311650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cfda330d-2176-41e8-832c-7938ced53460 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:49.322895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cfda330d-2176-41e8-832c-7938ced53460 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1241 microversion: 2.1 time: 0.094943 Jul 29 12:55:49.324671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 388/750] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:49 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:49.431001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:49.431781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:49.440011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:49.441005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:49.442885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:49.443785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:49.589148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:49.597346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7b73c303-8925-4cbd-a842-037bff3b141d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1275 microversion: 2.1 time: 0.171926 Jul 29 12:55:49.597936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 363/751] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:49 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:49.857462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:49.858285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:49.865110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:49.865661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:49.866473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:49.866914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:49.994375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:50.001895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-212094b5-8c64-47af-b814-c9f35a932016 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1508 microversion: 2.1 time: 0.149130 Jul 29 12:55:50.002460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 389/752] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:49 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:50.344600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:50.345207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:50.352151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:50.352598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:50.353349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:50.353781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:50.412968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:50.420293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fcd610bc-142d-4974-a83c-d44a7a41da29 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1245 microversion: 2.1 time: 0.079575 Jul 29 12:55:50.420861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 364/753] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:50 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:50.619730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:50.620347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:50.626836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:50.627271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:50.628068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:50.628517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:50.760025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:50.767448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ed2bc56d-e3cf-40a3-8a9b-fabe8095199a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1275 microversion: 2.1 time: 0.151752 Jul 29 12:55:50.768006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 390/754] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:51.023410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:51.023941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:51.030443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:51.030921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:51.031670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:51.032108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:51.158217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:51.166349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f1d53703-d344-4584-ab7b-9c7f9b2961ab tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1508 microversion: 2.1 time: 0.147441 Jul 29 12:55:51.166909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 365/755] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:51 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:51.441378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:51.443004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:51.449618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:51.450273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:51.451187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:51.451699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:51.515336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:51.525626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5e9a7dcb-e9ea-4b47-9511-e0ac000f6807 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1237 microversion: 2.1 time: 0.088209 Jul 29 12:55:51.533446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 391/756] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:51 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:51.789297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:51.789907 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:51.796451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:51.798027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:51.798833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:51.799511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:52.080467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:52.090223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b663a13f-e8ba-4a32-aa14-3d958846d713 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.305393 Jul 29 12:55:52.091957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 366/757] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:52.187639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:52.189008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:52.197928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:52.198856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:52.199853 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:52.200636 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:52.322421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-e6a6eca7-926c-4557-b44f-b2fd138f9f16 req-9df53f1b-e661-4bb4-bd25-fb0f6a49c24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b362a80f-715f-4c80-8dae-26d950ffc42a", "tag": "6fe329f5-796e-43de-8e36-ae61133c8878"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:52.338602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-e6a6eca7-926c-4557-b44f-b2fd138f9f16 req-9df53f1b-e661-4bb4-bd25-fb0f6a49c24d service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:52.339647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-e6a6eca7-926c-4557-b44f-b2fd138f9f16 req-9df53f1b-e661-4bb4-bd25-fb0f6a49c24d service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:52.354307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-e6a6eca7-926c-4557-b44f-b2fd138f9f16 req-9df53f1b-e661-4bb4-bd25-fb0f6a49c24d service nova] Creating event network-changed:6fe329f5-796e-43de-8e36-ae61133c8878 for instance b362a80f-715f-4c80-8dae-26d950ffc42a on hv-cinder-81914 Jul 29 12:55:52.369448 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-e6a6eca7-926c-4557-b44f-b2fd138f9f16 req-9df53f1b-e661-4bb4-bd25-fb0f6a49c24d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051218 Jul 29 12:55:52.372149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 367/758] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:52.528162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:52.536940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b063cdea-2091-4ba3-b5c8-5875dc6a7695 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 200 len: 1508 microversion: 2.1 time: 0.353346 Jul 29 12:55:52.538210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 392/759] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:52 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:52.557057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:52.558087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:52.566620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:52.567775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:52.568765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:52.569724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:52.869568 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:52.880283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:52.889841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-96ba61fb-941a-42ad-a185-0ce1ed2fd3d5 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1299 microversion: 2.1 time: 0.337352 Jul 29 12:55:52.903882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 368/760] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:52 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:53.117605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:53.118532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:53.125269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.125713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.126577 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.127013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.261965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:53.270344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3730b5ed-e45b-4436-ae38-96941e2d9340 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.157295 Jul 29 12:55:53.270944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 393/761] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:53 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:53.557667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:53.558306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ef193532-ce6d-490e-934b-900337d13fd7] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:53.565418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.565931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.566702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.567781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.581297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] HTTP exception thrown: Instance ef193532-ce6d-490e-934b-900337d13fd7 could not be found. Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Request method failure captured: Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 HTTP/1.1 Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eRa0q_DgInPevO1z84sH37ZI1Mvwr4czUglHFjXqXy7ltot0wnWU-IMbqJJ8NCi6rhIv8kM5Zk0N56Yf4tNk_aGZOt3sNgq46u91ql66RqyLU0QJZAJW1ZRzBtmEOHfuWdq_RCTt69PavK-gC4ddGmgJLnO60JNEZCVPEwnfStPcI Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:55:53.583013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 1dd24e8c0d214a0bb62578f9834a40a2 Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance ef193532-ce6d-490e-934b-900337d13fd7 could not be found. Jul 29 12:55:53.584389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'ef193532-ce6d-490e-934b-900337d13fd7'} Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef193532-ce6d-490e-934b-900337d13fd7 could not be found. Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:55:53.585186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef193532-ce6d-490e-934b-900337d13fd7 could not be found. Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef193532-ce6d-490e-934b-900337d13fd7 could not be found. Jul 29 12:55:53.586561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:55:53.587744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Returning 404 to user: Instance ef193532-ce6d-490e-934b-900337d13fd7 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:55:53.587744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-075d8cbb-ec18-4b30-8eaa-bcbb024470e4 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7" status: 404 len: 111 microversion: 2.1 time: 0.030519 Jul 29 12:55:53.587744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 369/762] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:53 2022] GET /compute/v2.1/servers/ef193532-ce6d-490e-934b-900337d13fd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:55:53.592814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:53.593308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:53.600608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.601060 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.601845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.602301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.627707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:55:53.630558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:53.724661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:53.739168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5f89cbb0-2f32-4477-840a-c9febab2aeea tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 204 len: 0 microversion: 2.1 time: 0.149723 Jul 29 12:55:53.741921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 394/763] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:55:53 2022] DELETE /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:55:53.755763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:53.757845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:53.767156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.767697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.768575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.769122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.912575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:53.913294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:53.919923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:53.920935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.921390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.922272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:53.922886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:53.929998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f82eb539-7b51-45d8-8a00-f7effc86ac6c tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.185774 Jul 29 12:55:53.930781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 370/764] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:53 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:54.167839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-ab68a24e-35d8-4815-9782-2a1c94dde1c1 req-fe1cbc14-dc9e-4add-b951-d459f0a8757a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd390942-6c97-4f6f-94c6-e1b8e65773a5", "tag": "70ca365d-1578-470d-808a-db14aa6b382b"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:54.179184 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ab68a24e-35d8-4815-9782-2a1c94dde1c1 req-fe1cbc14-dc9e-4add-b951-d459f0a8757a service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:54.179407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ab68a24e-35d8-4815-9782-2a1c94dde1c1 req-fe1cbc14-dc9e-4add-b951-d459f0a8757a service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:54.199793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-ab68a24e-35d8-4815-9782-2a1c94dde1c1 req-fe1cbc14-dc9e-4add-b951-d459f0a8757a service nova] Creating event network-changed:70ca365d-1578-470d-808a-db14aa6b382b for instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 on hv-cinder-81914 Jul 29 12:55:54.205122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-ab68a24e-35d8-4815-9782-2a1c94dde1c1 req-fe1cbc14-dc9e-4add-b951-d459f0a8757a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041289 Jul 29 12:55:54.207058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 371/765] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:55:54.242730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:54.250922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-42aa2859-02f0-48a6-8e5c-42112a48ab12 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.343402 Jul 29 12:55:54.251504 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 395/766] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:53 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:54.291857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:54.292497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:54.298847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:54.299303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:54.300074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:54.300703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:54.410781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-da332da8-50c4-4166-b6d0-db6c76090f74 req-edc2e618-3664-4a91-aa8d-419854b432c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef193532-ce6d-490e-934b-900337d13fd7", "name": "network-vif-deleted", "tag": "a20816b8-d6a9-4717-96f5-3ac642327781"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:54.420157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-da332da8-50c4-4166-b6d0-db6c76090f74 req-edc2e618-3664-4a91-aa8d-419854b432c1 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:54.420674 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-da332da8-50c4-4166-b6d0-db6c76090f74 req-edc2e618-3664-4a91-aa8d-419854b432c1 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:54.431396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-da332da8-50c4-4166-b6d0-db6c76090f74 req-edc2e618-3664-4a91-aa8d-419854b432c1 service nova] Creating event network-vif-deleted:a20816b8-d6a9-4717-96f5-3ac642327781 for instance ef193532-ce6d-490e-934b-900337d13fd7 on hv-cinder-81914 Jul 29 12:55:54.436149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-da332da8-50c4-4166-b6d0-db6c76090f74 req-edc2e618-3664-4a91-aa8d-419854b432c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 Jul 29 12:55:54.436728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 396/767] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:55:54.440160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:54.448292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4f7cc016-f30c-48d4-9cf2-c33fd0d76b41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.160665 Jul 29 12:55:54.448845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 372/768] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:54 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:54.953003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:54.953686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:54.960514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:54.960985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:54.961743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:54.962214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:55.092322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:55.100032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a6b295d0-604f-4f98-a942-43844d400484 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.151190 Jul 29 12:55:55.100601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 397/769] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:54 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:55.273511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:55.274045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:55.280571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:55.281019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:55.281766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:55.282225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:55.409163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:55.417069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4ffe2376-639d-4a80-8e32-0f3fe3a8f17d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.149293 Jul 29 12:55:55.417632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 373/770] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:55 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:55.469385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:55.470023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:55.477347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:55.477794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:55.478586 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:55.479108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:55.617574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:55.624993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4667c54e-80cc-4cfe-999e-95258a9f7eea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.159425 Jul 29 12:55:55.625557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 398/771] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:55 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:56.122994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:56.123601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:56.130221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:56.130672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:56.131436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:56.131873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:56.263814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:56.271266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0747c0ba-cb4a-457f-9d8c-42fb6d887afa tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.152210 Jul 29 12:55:56.271829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 374/772] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:56 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:56.438264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:56.438877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:56.444848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:56.445300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:56.446215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:56.448409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:56.579771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:56.587187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-45c442b2-f9b8-4d69-8c4f-acac620bfe91 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.152791 Jul 29 12:55:56.587740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 399/773] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:56 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:56.646109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:56.646696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:56.653055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:56.653502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:56.654280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:56.654713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:56.782831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:56.791666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-006b6381-09c2-4bfa-b985-5a9b00013406 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.149400 Jul 29 12:55:56.792237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 375/774] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:57.292481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:57.293084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:57.299462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:57.299908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:57.300666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:57.301155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:57.465750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:57.473478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fdc8b859-28bd-425b-9b1e-90df7ccdc295 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1522 microversion: 2.1 time: 0.184920 Jul 29 12:55:57.474134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 400/775] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:57 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:57.608139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:57.608751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:57.614874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:57.615331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:57.616104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:57.616538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:57.812917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:57.813632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:57.820236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:57.820905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:57.821702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:57.822391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:57.931136 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:57.939751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a60591ec-7389-4fbe-a345-83c70bdc5355 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.335406 Jul 29 12:55:57.940609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 376/776] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:57 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:58.063762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:58.072797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3fb9a08-e5e7-4954-89e3-f0f487e23f6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.263965 Jul 29 12:55:58.073566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 401/777] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:58.417425 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-d5d4c132-ce9b-4e3c-a768-f5169e4bc558 req-48e232ed-b930-434d-8054-504db9484321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1896a4-4e17-42e2-be2b-0fb84053871e", "name": "network-vif-deleted", "tag": "7460e3cb-918d-47f8-ab19-9563c7dc0751"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:55:58.426890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d5d4c132-ce9b-4e3c-a768-f5169e4bc558 req-48e232ed-b930-434d-8054-504db9484321 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:58.427339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d5d4c132-ce9b-4e3c-a768-f5169e4bc558 req-48e232ed-b930-434d-8054-504db9484321 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:58.438432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-d5d4c132-ce9b-4e3c-a768-f5169e4bc558 req-48e232ed-b930-434d-8054-504db9484321 service nova] Creating event network-vif-deleted:7460e3cb-918d-47f8-ab19-9563c7dc0751 for instance ed1896a4-4e17-42e2-be2b-0fb84053871e on hv-cinder-81914 Jul 29 12:55:58.443599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-d5d4c132-ce9b-4e3c-a768-f5169e4bc558 req-48e232ed-b930-434d-8054-504db9484321 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Jul 29 12:55:58.444212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 377/778] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:55:58.494962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:58.495577 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:58.501622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:58.502114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:58.502879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:58.503322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:58.584261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:58.591914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9f614243-7761-4527-994c-985984b2be13 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1480 microversion: 2.1 time: 0.100908 Jul 29 12:55:58.592475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 402/779] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:58 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1480 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:58.961408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:58.962126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:58.969179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:58.969639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:58.970439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:58.970881 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.094088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:59.094716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:59.098772 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:59.102056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:59.102599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.103371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:59.103812 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.106171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ea6f7f34-4532-4703-910c-38bb9d27d00a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.149415 Jul 29 12:55:59.106757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 378/780] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:58 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:55:59.234663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:59.235572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=4 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:59.236318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=12 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:59.242710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-903b0ebc-a0e9-47e0-ba97-fb0d4fd37607 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.152414 Jul 29 12:55:59.243286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 403/781] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:59 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:55:59.293968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:59.294585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:59.296461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:59.302233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:59.302767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.303548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:59.303991 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.327521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f7ba4ff1-1b9c-4bd5-b2a1-77644bec5473 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/ips" status: 200 len: 151 microversion: 2.20 time: 0.096572 Jul 29 12:55:59.328081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 379/782] 10.222.0.66 () {60 vars in 1289 bytes} [Fri Jul 29 12:55:59 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/ips => generated 151 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:55:59.612758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:55:59.614654 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:55:59.616745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=8 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:55:59.622351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:59.622875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.623730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:55:59.624232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:55:59.687833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd24e8c0d214a0bb62578f9834a40a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdcbcec39334733a5fa29ddc40c7a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:55:59.695359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-679ead94-7d74-43f8-85af-f0871d0f8db3 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 200 len: 1306 microversion: 2.1 time: 0.086550 Jul 29 12:55:59.695924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 404/783] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:55:59 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:00.127134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:00.127745 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:00.134348 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:00.134802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:00.135575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:00.136034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:00.265396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:00.266054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:00.276698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:00.283933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:00.284392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:00.285211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:00.286276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:00.286743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6d03d66a-607c-417d-b18b-1ea2f7ccfef1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.162464 Jul 29 12:56:00.287587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 380/784] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:00 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:00.424788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:00.433352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2f6b2683-c1b4-4428-b3a6-fc8529dda9fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.172258 Jul 29 12:56:00.433950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 405/785] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:00.715903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:00.716517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] [instance: ed1896a4-4e17-42e2-be2b-0fb84053871e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:00.723614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:00.724072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:00.724841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:00.725284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:00.738769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] HTTP exception thrown: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e could not be found. Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Request method failure captured: Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e HTTP/1.1 Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eRa0q_DgInPevO1z84sH37ZI1Mvwr4czUglHFjXqXy7ltot0wnWU-IMbqJJ8NCi6rhIv8kM5Zk0N56Yf4tNk_aGZOt3sNgq46u91ql66RqyLU0QJZAJW1ZRzBtmEOHfuWdq_RCTt69PavK-gC4ddGmgJLnO60JNEZCVPEwnfStPcI Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:56:00.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9cdcbcec39334733a5fa29ddc40c7a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 9cdcbcec39334733a5fa29ddc40c7a2d Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1143452488 Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 1dd24e8c0d214a0bb62578f9834a40a2 Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1143452488-project Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e could not be found. Jul 29 12:56:00.741708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'ed1896a4-4e17-42e2-be2b-0fb84053871e'} Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e could not be found. Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:56:00.742596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e could not be found. Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e could not be found. Jul 29 12:56:00.743970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:00.745268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] Returning 404 to user: Instance ed1896a4-4e17-42e2-be2b-0fb84053871e could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:56:00.745268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9c095823-7d13-4005-bf41-affad056e825 tempest-ServerRescueNegativeTestJSON-1143452488 tempest-ServerRescueNegativeTestJSON-1143452488-project] 10.222.0.66 "GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e" status: 404 len: 111 microversion: 2.1 time: 0.029755 Jul 29 12:56:00.745268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 381/786] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:00 2022] GET /compute/v2.1/servers/ed1896a4-4e17-42e2-be2b-0fb84053871e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:56:01.307615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:01.308223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:01.314739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:01.315190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:01.315955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:01.316398 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:01.446294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:01.453794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aaca237f-5ee1-4395-8e12-8247cb0da2bb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.149942 Jul 29 12:56:01.454388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 406/787] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:01 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:56:01.455164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:01.455874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:01.462987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:01.463436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:01.464339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:01.464797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:01.683939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:01.691854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8e551a6e-5602-49ac-a938-8f925a1981ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.240961 Jul 29 12:56:01.692607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 382/788] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:01 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:01.836338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:01.837217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:01.843632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:01.844335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:01.845121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:01.845578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:01.872501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lazy-loading 'flavor' on Instance uuid 50d409fe-072b-4bec-975c-fc10d69ee0a2 {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:56:02.066222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7fa48558-ec0b-4638-bf0a-b2fb76cbe69d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/action" status: 202 len: 0 microversion: 2.20 time: 0.234672 Jul 29 12:56:02.067438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 407/789] 10.222.0.66 () {62 vars in 1319 bytes} [Fri Jul 29 12:56:01 2022] POST /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:56:02.076357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:02.076947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:02.084098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.084557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.085446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.085919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.282647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:02.291879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:02.293379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:02.294569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d58c4e8f-ba50-47fa-bc06-4731c125d0ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.222700 Jul 29 12:56:02.295322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 383/790] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:02 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:02.477166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:02.477987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:02.493609 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.499359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.500358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.500851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.532433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:02.634630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-d3a1f3eb-cf62-47c4-a1b4-e9145478dd0e req-1b21a19b-71dc-4408-b1ee-6a623cfffe75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd390942-6c97-4f6f-94c6-e1b8e65773a5", "name": "network-vif-plugged", "status": "completed", "tag": "70ca365d-1578-470d-808a-db14aa6b382b"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:02.646033 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d3a1f3eb-cf62-47c4-a1b4-e9145478dd0e req-1b21a19b-71dc-4408-b1ee-6a623cfffe75 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.646406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d3a1f3eb-cf62-47c4-a1b4-e9145478dd0e req-1b21a19b-71dc-4408-b1ee-6a623cfffe75 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.659543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-d3a1f3eb-cf62-47c4-a1b4-e9145478dd0e req-1b21a19b-71dc-4408-b1ee-6a623cfffe75 service nova] Creating event network-vif-plugged:70ca365d-1578-470d-808a-db14aa6b382b for instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 on hv-cinder-81914 Jul 29 12:56:02.668559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-d3a1f3eb-cf62-47c4-a1b4-e9145478dd0e req-1b21a19b-71dc-4408-b1ee-6a623cfffe75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037400 Jul 29 12:56:02.674965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 384/791] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:02.716226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:02.717187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:02.750742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.751426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.752384 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:02.752950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:02.883020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:02.893055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3be6b818-ed14-4a76-9638-818cb165124a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.421509 Jul 29 12:56:02.893646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 408/792] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:02 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:03.031937 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:03.040948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-68b81761-2dc9-4495-8d89-743c113d2754 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.329847 Jul 29 12:56:03.041538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 385/793] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:03.318630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:03.319515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:03.325876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:03.326577 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:03.328176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:03.328783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:03.575613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:03.583634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:03.585149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:03.586361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-55c229e5-05a9-450f-9393-54161a040dda tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.272192 Jul 29 12:56:03.586917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 409/794] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:03 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:03.916708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:03.918533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:03.933049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:03.933743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:03.935083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:03.935794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:04.063129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:04.063958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:04.074557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:04.075141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:04.076032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:04.076573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:04.090219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:04.098312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f13657c0-bd8b-4f51-8672-b35622f2a079 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1367 microversion: 2.1 time: 0.186951 Jul 29 12:56:04.099734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 386/795] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:03 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:04.437674 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:04.488870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cdb9fecd-18bc-455a-8276-55774c639d33 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.430645 Jul 29 12:56:04.490477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 410/796] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:04 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:04.611363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:04.611969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:04.618177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:04.618700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:04.619501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:04.619995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:04.707270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-76ed94cb-0d23-48ed-b0b7-5c2904b58436 req-e1b309e2-0313-4a16-9b02-99569fbf09a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362a80f-715f-4c80-8dae-26d950ffc42a", "name": "network-vif-plugged", "status": "completed", "tag": "6fe329f5-796e-43de-8e36-ae61133c8878"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:04.717394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-76ed94cb-0d23-48ed-b0b7-5c2904b58436 req-e1b309e2-0313-4a16-9b02-99569fbf09a7 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:04.717859 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-76ed94cb-0d23-48ed-b0b7-5c2904b58436 req-e1b309e2-0313-4a16-9b02-99569fbf09a7 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:04.733549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-76ed94cb-0d23-48ed-b0b7-5c2904b58436 req-e1b309e2-0313-4a16-9b02-99569fbf09a7 service nova] Creating event network-vif-plugged:6fe329f5-796e-43de-8e36-ae61133c8878 for instance b362a80f-715f-4c80-8dae-26d950ffc42a on hv-cinder-81914 Jul 29 12:56:04.740367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-76ed94cb-0d23-48ed-b0b7-5c2904b58436 req-e1b309e2-0313-4a16-9b02-99569fbf09a7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036687 Jul 29 12:56:04.741095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 411/797] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:04.759282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:04.767209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:04.768734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:04.769907 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fdb106dc-c86d-41a5-8ddc-45a79678a0c4 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.162780 Jul 29 12:56:04.770515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 387/798] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:04 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:05.122437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:05.123360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:05.130367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.130822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.131624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.132063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.289535 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:05.299261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f9855d20-770d-40bd-8319-a539f537b4b4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1558 microversion: 2.1 time: 0.183110 Jul 29 12:56:05.301851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 412/799] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:05 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:05.320415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:05.322584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:05.329291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.329742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.330614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.331050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.417867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6a71771d-90d7-49a4-815d-de44410ce619 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101938 Jul 29 12:56:05.418578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 388/800] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:56:05 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:05.514603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:05.515221 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:05.521753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.522246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.523287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.523544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.797106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:05.797896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:05.804234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.804876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.805841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:05.806443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:05.825477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:05.983964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:05.992192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:05.994022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:05.995384 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ee43fab1-5f79-47e8-86ed-8e4cac97512d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.203584 Jul 29 12:56:05.995943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 389/801] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:05 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:06.006747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:06.014908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0acc017e-9167-4eb7-817d-568e099da841 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1263 microversion: 2.1 time: 0.504059 Jul 29 12:56:06.015753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 413/802] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:05 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1263 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:06.812489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-e87fbc52-e14b-4602-9f0c-24eb21dc4113 req-4097f9d3-c652-4cb6-aac4-f11e324c9019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd390942-6c97-4f6f-94c6-e1b8e65773a5", "tag": "70ca365d-1578-470d-808a-db14aa6b382b"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:06.822428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-e87fbc52-e14b-4602-9f0c-24eb21dc4113 req-4097f9d3-c652-4cb6-aac4-f11e324c9019 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:06.822867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-e87fbc52-e14b-4602-9f0c-24eb21dc4113 req-4097f9d3-c652-4cb6-aac4-f11e324c9019 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:06.834329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-e87fbc52-e14b-4602-9f0c-24eb21dc4113 req-4097f9d3-c652-4cb6-aac4-f11e324c9019 service nova] Creating event network-changed:70ca365d-1578-470d-808a-db14aa6b382b for instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 on hv-cinder-81914 Jul 29 12:56:06.839147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-e87fbc52-e14b-4602-9f0c-24eb21dc4113 req-4097f9d3-c652-4cb6-aac4-f11e324c9019 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158940 Jul 29 12:56:06.839746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 390/803] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:07.021747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:07.022400 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:07.029224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:07.029759 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:07.031132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dfb7d877-1225-48eb-912b-7f71daa000b4 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1f530d0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:07.032173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:07.032694 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:07.117944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dfb7d877-1225-48eb-912b-7f71daa000b4 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/ad695de1-cf85-4e95-94f5-ea41c5a4c4d5" status: 200 len: 351 microversion: 2.1 time: 0.090757 Jul 29 12:56:07.119433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 391/804] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:56:07 2022] GET /compute/v2.1/os-volumes/ad695de1-cf85-4e95-94f5-ea41c5a4c4d5 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:07.131902 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:07.132656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:07.152582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:07.153046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:07.154358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:07.155823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:07.263043 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:07.272258 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:07.273784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:07.274983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-42aca923-1f7d-4062-a7c9-8d49317b0adb tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.257847 Jul 29 12:56:07.289844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 414/805] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:07 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:07.452506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:07.474434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0c58344f-1aa1-478f-9f85-54d5c83d13dd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1450 microversion: 2.1 time: 0.353911 Jul 29 12:56:07.490469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 392/806] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1450 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:07.497026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:07.497522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:07.504312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:07.504765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:07.505724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:07.506416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:07.649432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:07.658216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6ba7714f-4528-4dc2-a4b8-632288ae29b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1450 microversion: 2.1 time: 0.164917 Jul 29 12:56:07.658891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 415/807] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:08.300156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:08.300728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:08.307264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:08.307718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:08.308487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:08.308964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:08.439473 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:08.448292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:08.449943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:08.451101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-aef10ae6-f2f7-4102-893c-4469ec0e0adc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.155016 Jul 29 12:56:08.451662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 393/808] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:08 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:08.537454 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-da68d0ff-7000-4f81-bb62-4aadbfa95abb tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1e9f280>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:08.589624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-da68d0ff-7000-4f81-bb62-4aadbfa95abb tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/00b8308c-2264-435c-a9a7-2e049e7782be" status: 200 len: 350 microversion: 2.1 time: 0.056438 Jul 29 12:56:08.590449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 416/809] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:56:08 2022] GET /compute/v2.1/os-volumes/00b8308c-2264-435c-a9a7-2e049e7782be => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:09.324430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-7e25d82e-8d05-4b23-bb14-c017c9591ca5 req-b608da7a-396a-4e4b-93d3-6967a6284c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b362a80f-715f-4c80-8dae-26d950ffc42a", "tag": "6fe329f5-796e-43de-8e36-ae61133c8878"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:09.334819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-7e25d82e-8d05-4b23-bb14-c017c9591ca5 req-b608da7a-396a-4e4b-93d3-6967a6284c2a service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:09.335267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-7e25d82e-8d05-4b23-bb14-c017c9591ca5 req-b608da7a-396a-4e4b-93d3-6967a6284c2a service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:09.346064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-7e25d82e-8d05-4b23-bb14-c017c9591ca5 req-b608da7a-396a-4e4b-93d3-6967a6284c2a service nova] Creating event network-changed:6fe329f5-796e-43de-8e36-ae61133c8878 for instance b362a80f-715f-4c80-8dae-26d950ffc42a on hv-cinder-81914 Jul 29 12:56:09.351856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-7e25d82e-8d05-4b23-bb14-c017c9591ca5 req-b608da7a-396a-4e4b-93d3-6967a6284c2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031032 Jul 29 12:56:09.352436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 394/810] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:09.476971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:09.477628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:09.483895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:09.484558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:09.485328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:09.485960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:09.632427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:09.642284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:09.643809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:09.645544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-06ccd5d6-661b-4e4d-a667-fac8ff7d9b53 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.172622 Jul 29 12:56:09.646084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 417/811] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:09 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:09.945021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-422a2984-abc2-449f-9afa-4faddde10c5e tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1dd38b0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:09.995205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-422a2984-abc2-449f-9afa-4faddde10c5e tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/abddea8f-abeb-4537-b66d-0bb15f9ddf8d" status: 200 len: 351 microversion: 2.1 time: 0.054279 Jul 29 12:56:09.995918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 395/812] 10.222.0.66 () {58 vars in 1245 bytes} [Fri Jul 29 12:56:09 2022] GET /compute/v2.1/os-volumes/abddea8f-abeb-4537-b66d-0bb15f9ddf8d => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:10.009007 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a36444f5-bd6e-4363-8d7a-614d2aa8b633 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1e9fd30>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.093692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a36444f5-bd6e-4363-8d7a-614d2aa8b633 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088648 Jul 29 12:56:10.094389 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 418/813] 10.222.0.66 () {58 vars in 1134 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:10.107953 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9af47860-d9b0-4480-ad86-cff8f1f9e376 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1db48b0>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.194970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9af47860-d9b0-4480-ad86-cff8f1f9e376 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090675 Jul 29 12:56:10.195541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 396/814] 10.222.0.66 () {58 vars in 1149 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:10.208699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8429a18f-870b-4025-b017-735fff17a701 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1eac790>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.292800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8429a18f-870b-4025-b017-735fff17a701 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087812 Jul 29 12:56:10.297996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 419/815] 10.222.0.66 () {58 vars in 1134 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:10.306606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-eaa02ffe-0645-429c-b25f-f2185799ca29 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1decc10>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.395309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-eaa02ffe-0645-429c-b25f-f2185799ca29 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091827 Jul 29 12:56:10.396700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 397/816] 10.222.0.66 () {58 vars in 1167 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:10.409917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a7db059a-81bb-4dec-a7cd-40d57cc57951 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1e3e310>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.497075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a7db059a-81bb-4dec-a7cd-40d57cc57951 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090815 Jul 29 12:56:10.497878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 420/817] 10.222.0.66 () {58 vars in 1170 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:10.512550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.515039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:10.517183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7c5a97de-c447-4263-a25e-6de2ffa2cf62 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1eac550>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.522965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.523503 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.524346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.524849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.555882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-71dd37c7-6047-4cfb-b096-aff8ce877088 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047916 Jul 29 12:56:10.556516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 398/818] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:56:10.617678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7c5a97de-c447-4263-a25e-6de2ffa2cf62 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.103941 Jul 29 12:56:10.618416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 421/819] 10.222.0.66 () {58 vars in 1155 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:10.621091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.621645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:10.628529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.629559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.630425 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.630885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.633979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f693f731-cf60-4c72-a4d3-b5d2c2c81a00 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1ec48b0>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.658274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:56:10.719919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f693f731-cf60-4c72-a4d3-b5d2c2c81a00 tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089847 Jul 29 12:56:10.720493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 422/820] 10.222.0.66 () {58 vars in 1188 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:10.729658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.729658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:10.737401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b6b95b5c-f2a9-41cb-ab85-ac8537c69214 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 204 len: 0 microversion: 2.1 time: 0.120200 Jul 29 12:56:10.737986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 399/821] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:56:10 2022] DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:56:10.739848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.740911 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.742146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.742577 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.746137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f0e75484-51e2-4d37-9dda-2c586adbfc2c tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] Calling method '.version_select at 0x7f74a1f53280>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.831119 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f0e75484-51e2-4d37-9dda-2c586adbfc2c tempest-VolumesTestJSON-1128099862 tempest-VolumesTestJSON-1128099862-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088981 Jul 29 12:56:10.831706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 400/822] 10.222.0.66 () {58 vars in 1155 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:10.840829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:10.840829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:10.845082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.846049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:10.847209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:10.848048 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:11.015978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:11.024535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3a1f4d3a-f68a-43aa-9f99-ba2588d28a29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1672 microversion: 2.1 time: 0.191283 Jul 29 12:56:11.025127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 401/823] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1672 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:11.105033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:11.114153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:11.116083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:11.117090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-affe0e02-1c60-4d81-95f6-53d9e27c6024 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.395642 Jul 29 12:56:11.117652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 423/824] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:10 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:12.047202 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:12.048128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:12.057143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:12.057624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:12.058446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:12.058932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:12.141005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:12.141955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:12.149358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:12.150237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:12.151277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:12.151922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:12.217064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:12.227174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e249e4bf-240c-4c35-a95c-314b9b631037 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1672 microversion: 2.1 time: 0.184097 Jul 29 12:56:12.228158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 402/825] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:12 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:12.301507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:12.310340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:12.312153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:12.313310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a6665a1b-fa7d-4add-82a8-ed98da24f5ac tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.176576 Jul 29 12:56:12.313891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 424/826] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:12 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:13.248498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:13.249100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:13.255565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:13.256008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:13.256764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:13.257197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:13.337218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:13.337844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:13.345795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:13.346704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:13.348257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:13.349320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:13.510104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:13.518324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:13.519181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:13.520649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:13.521970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-90c67bcc-600d-4dab-a2dd-a050ed1c898f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1744 microversion: 2.20 time: 0.188509 Jul 29 12:56:13.522802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 425/827] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:13 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:13.531608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7aed0853-a59e-462b-8027-4fe2538777f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 200 len: 1672 microversion: 2.1 time: 0.286844 Jul 29 12:56:13.532474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 403/828] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:13 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 1672 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:14.017030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-66aced7a-d7c7-420e-8933-1a552eb7d211 req-a5933df6-3cae-49ba-b876-78ca55e7fda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d9675c-1827-4d5f-9ffc-2ec302ef475c", "name": "network-vif-deleted", "tag": "798338a9-4e08-4c38-8f25-863991fc313a"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:14.028131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-66aced7a-d7c7-420e-8933-1a552eb7d211 req-a5933df6-3cae-49ba-b876-78ca55e7fda6 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.028866 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-66aced7a-d7c7-420e-8933-1a552eb7d211 req-a5933df6-3cae-49ba-b876-78ca55e7fda6 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.044621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-66aced7a-d7c7-420e-8933-1a552eb7d211 req-a5933df6-3cae-49ba-b876-78ca55e7fda6 service nova] Creating event network-vif-deleted:798338a9-4e08-4c38-8f25-863991fc313a for instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c on hv-cinder-81914 Jul 29 12:56:14.050557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-66aced7a-d7c7-420e-8933-1a552eb7d211 req-a5933df6-3cae-49ba-b876-78ca55e7fda6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037347 Jul 29 12:56:14.051261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 426/829] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:14.298559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-793933590"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:14.299114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:14.306259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.306711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.307542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.307980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.437441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.network.security_group_api [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Removing security group 05c498eb-68f1-4f62-b127-338e3697cc05 from port c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 Jul 29 12:56:14.546255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:14.547069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:14.558458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.559155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.561641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.562416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.746030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:14.756484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:14.759797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:14.764907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0b394f19-6aca-4490-8090-ac0873df6903 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1744 microversion: 2.20 time: 0.221204 Jul 29 12:56:14.778939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 427/830] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:14 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:14.789092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:14.790167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:14.796777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.797522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.798552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:14.799347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:14.815776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] HTTP exception thrown: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Request method failure captured: Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c HTTP/1.1 Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49fk3Rs_iAESg1_sZjEEX-mNZC8cQ_6DqMGCvoG3aPTg7fnjR3c39A2RpB1A1uU39T7U1I8SoAisDCOTcSd09wGAeYMuoEDLyQU6Smeb4dnRaILkgIHt7Kqdisu6ZSeAjcKMUPkSUekTKOzptG06OfEL5UtXC1oJvoqWMcc49pNtaLY Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:56:14.818637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeTestJSON-1670024508 Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 03f312d5c7334ccc82be17c5dfe29aeb Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 12:56:14.820498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '80d9675c-1827-4d5f-9ffc-2ec302ef475c'} Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:56:14.821466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 12:56:14.822926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:14.824958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Returning 404 to user: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:56:14.826237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fad4c037-e03f-4a85-8dd4-51a04f6be7c2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 404 len: 111 microversion: 2.1 time: 0.045877 Jul 29 12:56:14.827283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 428/831] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:14 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:56:14.848652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b37a590c-1520-43a3-8dc2-87918a172576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '.version_select at 0x7f74a2126160>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:14.872230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b37a590c-1520-43a3-8dc2-87918a172576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146083784" status: 202 len: 0 microversion: 2.1 time: 0.040076 Jul 29 12:56:14.873920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 429/832] 10.222.0.66 () {58 vars in 1218 bytes} [Fri Jul 29 12:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146083784 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 12:56:14.957785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-11f5a9e4-270e-4753-8409-2b46a7876324 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/action" status: 202 len: 0 microversion: 2.1 time: 0.663082 Jul 29 12:56:14.958824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 404/833] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 12:56:14 2022] POST /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:56:15.794304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:15.794921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:15.804956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:15.805418 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:15.806414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:15.807022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:15.904941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2a0be048-8b5c-44bc-a564-c1004203c86a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: .version_select at 0x7f74a1dbf280>, body: {"keypair": {"name": "tempest-keypair-87267584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw/2NprRjrgJUb7FYbPSY3dRqjfq07VAZgZKxuqaXVvb+If4F6tcEG5NX/WLReQpIM2ZSjJnY3BykNgrNrf4jQT3KnqH0vmqTDunmclj6+zQW/5U/addLViqJSTKIrR1w=="}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:15.926911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-2a0be048-8b5c-44bc-a564-c1004203c86a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for project f36dffd2ab1643ed939ffe87e5928187. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:56:15.933288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-2a0be048-8b5c-44bc-a564-c1004203c86a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for user 03f312d5c7334ccc82be17c5dfe29aeb and project f36dffd2ab1643ed939ffe87e5928187. Resources: {'key_pairs'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:56:15.960274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2a0be048-8b5c-44bc-a564-c1004203c86a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.066349 Jul 29 12:56:15.961079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 405/834] 10.222.0.66 () {60 vars in 1159 bytes} [Fri Jul 29 12:56:15 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:16.067198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-6736cc9e-8a26-493f-9f22-fd969616c149 req-67417bc2-30e2-479e-b2b9-4e98c3e3e39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:16.084352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-6736cc9e-8a26-493f-9f22-fd969616c149 req-67417bc2-30e2-479e-b2b9-4e98c3e3e39b service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:16.085164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-6736cc9e-8a26-493f-9f22-fd969616c149 req-67417bc2-30e2-479e-b2b9-4e98c3e3e39b service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:16.136978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:16.137733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-6736cc9e-8a26-493f-9f22-fd969616c149 req-67417bc2-30e2-479e-b2b9-4e98c3e3e39b service nova] Creating event network-changed:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:56:16.143974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-6736cc9e-8a26-493f-9f22-fd969616c149 req-67417bc2-30e2-479e-b2b9-4e98c3e3e39b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080095 Jul 29 12:56:16.146597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 406/835] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:16.148003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:16.149836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:16.151436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6f016230-e99c-42a0-a34a-7a7c5ff52860 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.361893 Jul 29 12:56:16.158299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 430/836] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:15 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:16.845521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-cb460a7c-236e-456d-97d3-f9626db670f3 req-e9741630-c56b-4d52-b16c-7e7dd61decba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "name": "network-vif-plugged", "status": "completed", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:16.869397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-cb460a7c-236e-456d-97d3-f9626db670f3 req-e9741630-c56b-4d52-b16c-7e7dd61decba service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:16.869860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-cb460a7c-236e-456d-97d3-f9626db670f3 req-e9741630-c56b-4d52-b16c-7e7dd61decba service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:16.886100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-cb460a7c-236e-456d-97d3-f9626db670f3 req-e9741630-c56b-4d52-b16c-7e7dd61decba service nova] Creating event network-vif-plugged:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:56:16.894915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-cb460a7c-236e-456d-97d3-f9626db670f3 req-e9741630-c56b-4d52-b16c-7e7dd61decba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296923 Jul 29 12:56:16.897113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 407/837] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:17.146916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:17.147396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:17.157909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-48713d58-d0d5-43cd-a355-a334c0f0d457 req-c8755d18-9471-40e0-8ab1-2b751b4b4a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:17.174063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.175200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.177202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.179873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.192837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-48713d58-d0d5-43cd-a355-a334c0f0d457 req-c8755d18-9471-40e0-8ab1-2b751b4b4a81 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.196572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-48713d58-d0d5-43cd-a355-a334c0f0d457 req-c8755d18-9471-40e0-8ab1-2b751b4b4a81 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.254868 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-48713d58-d0d5-43cd-a355-a334c0f0d457 req-c8755d18-9471-40e0-8ab1-2b751b4b4a81 service nova] Creating event network-changed:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:56:17.263617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-48713d58-d0d5-43cd-a355-a334c0f0d457 req-c8755d18-9471-40e0-8ab1-2b751b4b4a81 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111195 Jul 29 12:56:17.264237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 408/838] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:17.290284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:17.291671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:17.304908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.305715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.308274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.308808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.357591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lazy-loading 'services' on Instance uuid 955c29c0-5301-458c-ab0c-2c83142ac26e {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:56:17.509593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9303adcb-f6f3-4b9c-81c3-6554df049e39 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments/971173f7-a773-4e63-927a-8c41b75ed862" status: 202 len: 0 microversion: 2.1 time: 0.367349 Jul 29 12:56:17.510853 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 431/839] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:56:17 2022] DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments/971173f7-a773-4e63-927a-8c41b75ed862 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:56:17.532591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:17.538648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:17.546793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.547508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.548862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:17.549522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:17.605809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b0243ec4-404a-4dc6-96b3-5fc2fc33ba81 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090596 Jul 29 12:56:17.610904 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 432/840] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:56:17 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:17.773381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:17.781408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:17.782951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:17.784124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8c65491c-ae61-4775-a8bd-f7c459ad7582 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.515273 Jul 29 12:56:17.799870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 409/841] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:17 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:18.620929 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:18.624311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:18.643778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:18.656003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:18.663232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:18.663923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:18.704018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:18.718402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-798b0f0c-a5b5-4051-a527-c3b134cf2a1f tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103067 Jul 29 12:56:18.719682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 433/842] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:56:18 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:56:18.737137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:18.737699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:18.764542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:18.773161 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:18.774298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:18.776231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:18.808092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:18.809406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:18.832043 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:18.833716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:18.837014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:18.837651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:18.974985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] HTTP exception thrown: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e is not attached to volume 971173f7-a773-4e63-927a-8c41b75ed862 Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Request method failure captured: Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments/971173f7-a773-4e63-927a-8c41b75ed862 HTTP/1.1 Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49gsXv5w6pY-bWSsjM-cpVBkyu1f_PqBVaxB6i_ww67njjvcL7vIl2NW8PCwozSNTx9quA3vC7w-C2fzYng0XgL2taJf6ZcOTJkvKXI-ddviAu-FFPNRnEqYNcSCuZsb1pceAdsRi5vmnFb181ZjkhSdlD4mdnZb6B1sh2i0PkjYH-g Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 3686c63736c7409eb7cc4170607ca6fb Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-TestMinimumBasicScenario-1233385491 Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:56:18.982449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-TestMinimumBasicScenario-1233385491 Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 3686c63736c7409eb7cc4170607ca6fb Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1233385491 Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-TestMinimumBasicScenario-1233385491-project Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 9a73d627ff2b4826b3ab025f5eea27f6 Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-TestMinimumBasicScenario-1233385491-project Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:56:18.984135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e is not attached to volume 971173f7-a773-4e63-927a-8c41b75ed862 Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'server_id': '955c29c0-5301-458c-ab0c-2c83142ac26e', 'id': '971173f7-a773-4e63-927a-8c41b75ed862'} Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 971173f7-a773-4e63-927a-8c41b75ed862. Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:56:18.984985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e is not attached to volume 971173f7-a773-4e63-927a-8c41b75ed862 Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e is not attached to volume 971173f7-a773-4e63-927a-8c41b75ed862 Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:56:18.986371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Returning 404 to user: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e is not attached to volume 971173f7-a773-4e63-927a-8c41b75ed862 {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:56:18.987633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c12ae054-d0e9-4810-86a4-5fd8d0608f6a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments/971173f7-a773-4e63-927a-8c41b75ed862" status: 404 len: 154 microversion: 2.1 time: 0.259269 Jul 29 12:56:18.987633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 410/843] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:56:18 2022] DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e/os-volume_attachments/971173f7-a773-4e63-927a-8c41b75ed862 => generated 154 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:56:19.063111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:19.077456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:19.079455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:19.081308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5daad1a2-9c59-43e6-9893-0dbbf6441434 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.277688 Jul 29 12:56:19.082622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 434/844] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:18 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:19.499973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1106011821", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "687edcc3-e1e0-42df-9df9-ceabe263b0fd"}], "security_groups": [{"name": "tempest-securitygroup--1762321410"}], "key_name": "tempest-keypair-87267584", "user_data": "}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:19.632019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] validate_networks() for [('687edcc3-e1e0-42df-9df9-ceabe263b0fd', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 12:56:20.055258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 12:56:20.056397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 12:56:20.056867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 12:56:20.057286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 12:56:20.057926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 12:56:20.067881 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.068338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.069148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.069591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.088538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for project f36dffd2ab1643ed939ffe87e5928187. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 12:56:20.092591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Getting quotas for user 03f312d5c7334ccc82be17c5dfe29aeb and project f36dffd2ab1643ed939ffe87e5928187. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 12:56:20.105897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 12:56:20.108491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 12:56:20.109528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:20.110707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:20.118196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.118976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.119934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.120407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.176577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-75938c3f-ce7e-4aa5-bc76-9ca5f207028b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.681535 Jul 29 12:56:20.186185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 411/845] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 12:56:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 12:56:20.197063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1a93413d-63df-4830-9a12-e8bca8a0165c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:20.197984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1a93413d-63df-4830-9a12-e8bca8a0165c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:20.276574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1a93413d-63df-4830-9a12-e8bca8a0165c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:20.287906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1a93413d-63df-4830-9a12-e8bca8a0165c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1236 microversion: 2.1 time: 0.097351 Jul 29 12:56:20.288615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 412/846] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:20.305077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:20.305253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:20.305618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:20.313314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.313769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.314547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.314781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:20.315149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.316901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:20.318088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-061630e9-e448-4e2e-88ca-83882a2d3eb1 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.213903 Jul 29 12:56:20.339089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 435/847] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:20 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:20.346907 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:56:20.481027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-85fc70e9-0218-40d1-adbe-d73b6b606037 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 204 len: 0 microversion: 2.1 time: 0.186585 Jul 29 12:56:20.484839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 413/848] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:56:20 2022] DELETE /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:56:20.493894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:20.494515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:20.501321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.501775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.502583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:20.503155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:20.672011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:20.681276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-333b9bd3-d82e-4e94-8506-26025ddbfe2a tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1554 microversion: 2.1 time: 0.192137 Jul 29 12:56:20.695668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 436/849] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:20 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:21.309804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:21.310666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:21.312582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:21.327252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:21.328052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:21.329086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:21.329741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:21.335882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:21.346036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:21.347019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:21.360466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:21.361050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:21.361977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:21.362524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:21.412829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:21.423069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-187bb5db-5f9c-463b-8c98-9543c7327851 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1240 microversion: 2.1 time: 0.117833 Jul 29 12:56:21.424912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 414/850] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:21.537020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:21.548626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:21.550672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:21.551838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c0689c8e-c76b-4310-ba20-be3a9c3742df tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.209839 Jul 29 12:56:21.552396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 437/851] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:21 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:21.703848 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:21.704801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:21.710954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:21.711694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:21.712674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:21.713114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:21.873865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:21.882651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2f55495a-59a3-4591-8940-f039bf603514 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1554 microversion: 2.1 time: 0.182652 Jul 29 12:56:21.883549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 415/852] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:21 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:22.444833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:22.445768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:22.452804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:22.453686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:22.454899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:22.455481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:22.521414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:22.534507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a3439c91-2990-469e-be79-159bc07593fd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1240 microversion: 2.1 time: 0.093311 Jul 29 12:56:22.547570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 438/853] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:22.575749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:22.576352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:22.583414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:22.583852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:22.584618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:22.585051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:22.745102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:22.753413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:22.755213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:22.756377 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-38981150-bb4d-4c58-9363-edf445783b41 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.184784 Jul 29 12:56:22.757180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 416/854] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:22 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:22.907591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:22.908180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:22.914510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:22.917284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:22.918097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:22.918696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:23.068005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:23.075775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3619709f-67df-4f29-900b-264cc4ec533b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1554 microversion: 2.1 time: 0.172895 Jul 29 12:56:23.076342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 439/855] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:22 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:23.557790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:23.558755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:23.568067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:23.568634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:23.569530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:23.570013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:23.645124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:23.653411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9ebdea04-35c4-4d31-8167-e6013b8ef421 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1240 microversion: 2.1 time: 0.101408 Jul 29 12:56:23.654129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 417/856] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:23.780994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:23.781797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:23.788863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:23.789789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:23.790597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:23.791033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:23.940165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:23.951910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:23.954780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:23.956482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3d247d28-1fbc-4e76-8bcf-b67b4daa45a3 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.179801 Jul 29 12:56:23.957049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 440/857] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:23 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:24.099516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:24.100376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:24.107131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:24.107590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:24.108405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:24.108846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:24.256167 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:24.265403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4790d2dc-b440-42f2-bf6b-5b4bd909d192 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1554 microversion: 2.1 time: 0.170458 Jul 29 12:56:24.266333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 418/858] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:24 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:24.674733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:24.675884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:24.677914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:24.683751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:24.684555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:24.685394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:24.685867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:24.754889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:24.763403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8ebd5097-7e8b-44f6-beed-172a96ed469b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1240 microversion: 2.1 time: 0.092450 Jul 29 12:56:24.764380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 441/859] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:56:24.985358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:24.985945 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:24.994743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:24.995479 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:24.996265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:24.996705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:25.158640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:25.170049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:25.171956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:25.173273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c93551a2-182b-4896-b1ec-a8c607196b40 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.193859 Jul 29 12:56:25.176340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 419/860] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:24 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:25.291763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:25.293063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:25.300493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:25.301171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:25.302166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:25.302801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:25.481810 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:25.492680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8f4c88c3-5cbe-4360-8f8b-d540fdd3e312 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1554 microversion: 2.1 time: 0.204907 Jul 29 12:56:25.493358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 442/861] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:25 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:25.784265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:25.785700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:25.791936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:25.792390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:25.793170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:25.795876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:25.871667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:25.879352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-90a0684e-95ed-49ba-8dc2-fcbffacc397b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1232 microversion: 2.1 time: 0.098858 Jul 29 12:56:25.892742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 420/862] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1232 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:26.201022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:26.201983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:26.210120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.210785 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.212437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.213030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.390025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:26.400826 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:26.412691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:26.414623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bb948673-da51-4fc9-bd7a-8c8657ff0b92 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.217963 Jul 29 12:56:26.418165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 443/863] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:26 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:26.522244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:26.522975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:26.539678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.540375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.543291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.543742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.706816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:26.716536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-83227d1d-dc4b-4e5b-942d-e125d90d5ef2 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1512 microversion: 2.1 time: 0.202536 Jul 29 12:56:26.731344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 421/864] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:26 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:26.884235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-f01eb988-7fc7-4422-9187-5606e3e1cb54 req-4fef194d-d25c-48e6-87d2-041c8efb057f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c29c0-5301-458c-ab0c-2c83142ac26e", "name": "network-vif-deleted", "tag": "c8bca8af-be89-4bc7-ae95-2f5cacf2ead9"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:26.897437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f01eb988-7fc7-4422-9187-5606e3e1cb54 req-4fef194d-d25c-48e6-87d2-041c8efb057f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.897781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-f01eb988-7fc7-4422-9187-5606e3e1cb54 req-4fef194d-d25c-48e6-87d2-041c8efb057f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.901095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:26.901648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:26.910376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.910852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.911830 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:26.913179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:26.932913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-f01eb988-7fc7-4422-9187-5606e3e1cb54 req-4fef194d-d25c-48e6-87d2-041c8efb057f service nova] Creating event network-vif-deleted:c8bca8af-be89-4bc7-ae95-2f5cacf2ead9 for instance 955c29c0-5301-458c-ab0c-2c83142ac26e on hv-cinder-81914 Jul 29 12:56:26.933207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-f01eb988-7fc7-4422-9187-5606e3e1cb54 req-4fef194d-d25c-48e6-87d2-041c8efb057f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053228 Jul 29 12:56:26.934088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 444/865] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:27.007218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:27.021692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14a23ad7-bf0a-459b-898f-c768121effa4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1288 microversion: 2.1 time: 0.124566 Jul 29 12:56:27.022900 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 422/866] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:27.467878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:27.468601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:27.484008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:27.484459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:27.486686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:27.492726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:27.738717 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:27.739952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:27.750867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:27.751578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:27.752541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:27.757176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:27.820522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:27.827234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:27.828027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lazy-loading 'fault' on Instance uuid 955c29c0-5301-458c-ab0c-2c83142ac26e {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:56:27.877222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:27.891184 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:27.897292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:27.898947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7f0ad0a6-72b0-446d-95f8-092e142a6ab6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1739 microversion: 2.20 time: 0.439706 Jul 29 12:56:27.900982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 445/867] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:27 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:27.909310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a73d627ff2b4826b3ab025f5eea27f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3686c63736c7409eb7cc4170607ca6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:27.923744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-17a6062c-9931-4a92-9083-ae612d5c5a19 tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 200 len: 1348 microversion: 2.1 time: 0.188024 Jul 29 12:56:27.926312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 423/868] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:27 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 1348 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:56:28.044466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:28.046664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:28.055234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:28.056055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:28.057269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:28.057956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:28.146092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:28.155468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-25448bd3-ea3c-4a30-b056-b54e13cef2fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1294 microversion: 2.1 time: 0.114950 Jul 29 12:56:28.156558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 446/869] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:28.927793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:28.929068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:28.938060 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:28.938684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:28.939991 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:28.940385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:28.949895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:28.952057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] [instance: 955c29c0-5301-458c-ab0c-2c83142ac26e] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:28.968224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:28.968784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:28.970047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:28.970588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:28.991264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] HTTP exception thrown: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e could not be found. Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Request method failure captured: Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e HTTP/1.1 Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49gsXv5w6pY-bWSsjM-cpVBkyu1f_PqBVaxB6i_ww67njjvcL7vIl2NW8PCwozSNTx9quA3vC7w-C2fzYng0XgL2taJf6ZcOTJkvKXI-ddviAu-FFPNRnEqYNcSCuZsb1pceAdsRi5vmnFb181ZjkhSdlD4mdnZb6B1sh2i0PkjYH-g Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 3686c63736c7409eb7cc4170607ca6fb Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-TestMinimumBasicScenario-1233385491 Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:56:28.994734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3686c63736c7409eb7cc4170607ca6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-TestMinimumBasicScenario-1233385491 Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 3686c63736c7409eb7cc4170607ca6fb Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1233385491 Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-TestMinimumBasicScenario-1233385491-project Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 9a73d627ff2b4826b3ab025f5eea27f6 Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-TestMinimumBasicScenario-1233385491-project Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e could not be found. Jul 29 12:56:28.996327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '955c29c0-5301-458c-ab0c-2c83142ac26e'} Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e could not be found. Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:56:28.997459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e could not be found. Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e could not be found. Jul 29 12:56:28.998917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:29.000333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Returning 404 to user: Instance 955c29c0-5301-458c-ab0c-2c83142ac26e could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:56:29.000333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-380a37f8-04eb-4a60-adf2-18865e0b677b tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e" status: 404 len: 111 microversion: 2.1 time: 0.049530 Jul 29 12:56:29.000333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 447/870] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:28 2022] GET /compute/v2.1/servers/955c29c0-5301-458c-ab0c-2c83142ac26e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:56:29.005623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-82ddebc6-a553-42eb-a9ef-accbaa6a6f5e tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] Calling method '.version_select at 0x7f74a1ee2550>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:29.028491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-82ddebc6-a553-42eb-a9ef-accbaa6a6f5e tempest-TestMinimumBasicScenario-1233385491 tempest-TestMinimumBasicScenario-1233385491-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1206041811" status: 202 len: 0 microversion: 2.1 time: 0.026943 Jul 29 12:56:29.029587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 448/871] 10.222.0.66 () {58 vars in 1272 bytes} [Fri Jul 29 12:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1206041811 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:56:29.194371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:29.197543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:29.250669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:29.251425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:29.252423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:29.253569 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:29.256170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:29.270625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:29.273297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:29.276439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b45e0d7e-1f32-4093-958f-2794f9513438 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1721 microversion: 2.20 time: 0.353803 Jul 29 12:56:29.279873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 424/872] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:28 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:29.510549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:29.518962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aa96b457-ffd7-44b4-8ca5-208484e05d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.344329 Jul 29 12:56:29.521983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 449/873] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:29.741620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-ac92576f-b5d4-4045-83dc-1ccb69243919 req-3696a47e-ea5b-470a-af6c-e2d7add49a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0648f4c1-242e-4fa9-ad53-9f4d24cfe259", "tag": "a0eea1bb-4265-4a85-be70-37e7d42b5c16"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:29.765943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ac92576f-b5d4-4045-83dc-1ccb69243919 req-3696a47e-ea5b-470a-af6c-e2d7add49a7d service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:29.768479 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-ac92576f-b5d4-4045-83dc-1ccb69243919 req-3696a47e-ea5b-470a-af6c-e2d7add49a7d service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:29.808192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-ac92576f-b5d4-4045-83dc-1ccb69243919 req-3696a47e-ea5b-470a-af6c-e2d7add49a7d service nova] Creating event network-changed:a0eea1bb-4265-4a85-be70-37e7d42b5c16 for instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 on hv-cinder-81914 Jul 29 12:56:29.826355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-ac92576f-b5d4-4045-83dc-1ccb69243919 req-3696a47e-ea5b-470a-af6c-e2d7add49a7d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088817 Jul 29 12:56:29.832946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 425/874] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:30.305851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:30.306536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:30.313707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:30.314430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:30.315205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:30.315846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:30.509014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:30.512041 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:30.513466 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=12 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:30.518393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-4d83724f-c26a-4265-b4de-3cb99ca8780b req-42777d67-198e-4333-bb7a-18cb98b0d155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "name": "network-vif-unplugged", "status": "completed", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:30.541149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-4d83724f-c26a-4265-b4de-3cb99ca8780b req-42777d67-198e-4333-bb7a-18cb98b0d155 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:30.541443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:30.543713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:30.545284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-4d83724f-c26a-4265-b4de-3cb99ca8780b req-42777d67-198e-4333-bb7a-18cb98b0d155 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:30.549092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-714a02e7-63a4-463d-b58d-05979580609f tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1721 microversion: 2.20 time: 0.244817 Jul 29 12:56:30.550412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 450/875] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:30 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:30.567245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:30.568050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:30.575529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:30.575976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:30.576547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-4d83724f-c26a-4265-b4de-3cb99ca8780b req-42777d67-198e-4333-bb7a-18cb98b0d155 service nova] Creating event network-vif-unplugged:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:56:30.577154 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:30.577619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:30.583742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-4d83724f-c26a-4265-b4de-3cb99ca8780b req-42777d67-198e-4333-bb7a-18cb98b0d155 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071332 Jul 29 12:56:30.584613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 426/876] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:30.960909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:30.974714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c47f1003-d332-4c27-8a6c-8f2bef3eeb0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.423347 Jul 29 12:56:30.975327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 451/877] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:31.579375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:31.580668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:31.588003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:31.588556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:31.589440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:31.589982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:31.824322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:31.834952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:31.837022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:31.838447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2bab4364-da9e-4cb7-9bc3-9fcde4ff333c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1721 microversion: 2.20 time: 0.264293 Jul 29 12:56:31.839532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 427/878] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:31 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:31.997633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:32.002204 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:32.010466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:32.011055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:32.012529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:32.013065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:32.038701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:32.561352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:32.571044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-357ca96a-648f-467f-9838-88c06985ba20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.578889 Jul 29 12:56:32.572646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 452/879] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:32.874227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:32.876032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:32.884527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:32.885383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:32.886204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:32.886820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.038955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:33.047815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:33.049329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:33.050585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9ed78d6c-89e5-4f81-9c08-c3551a5dfba8 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1664 microversion: 2.20 time: 0.191911 Jul 29 12:56:33.051151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 428/880] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:32 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1664 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:33.074214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79336574-0507-40d0-97b3-f0a6c36497d3"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:33.076495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:33.082757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:33.083295 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.084125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:33.084627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.432742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dd1e4989-b460-44bf-a478-934cd1c73eed tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362555 Jul 29 12:56:33.433335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 453/881] 10.222.0.66 () {62 vars in 1364 bytes} [Fri Jul 29 12:56:33 2022] POST /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 12:56:33.593288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:33.594666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:33.605017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:33.607808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.608836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:33.611047 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.654656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:33.655492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:33.662930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:33.663689 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.664655 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:33.665375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:33.996000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:34.011110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cdea14c0-b877-4ade-91fc-c5f09734c78c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.422182 Jul 29 12:56:34.025428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 429/882] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:34.063004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-982a4bd4-c86a-4744-9ca5-ea599bfd1829 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-volume_attachments/79336574-0507-40d0-97b3-f0a6c36497d3" status: 202 len: 0 microversion: 2.20 time: 0.412195 Jul 29 12:56:34.068961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 454/883] 10.222.0.66 () {60 vars in 1457 bytes} [Fri Jul 29 12:56:33 2022] DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-volume_attachments/79336574-0507-40d0-97b3-f0a6c36497d3 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 12:56:34.150683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:34.151381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:34.163369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:34.164765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:34.165635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:34.169607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:34.231428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129323) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 12:56:34.294456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:34.310793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-df5d9f03-6a75-494e-91a3-27c26ee28ece tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "POST /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/action" status: 202 len: 0 microversion: 2.20 time: 0.165355 Jul 29 12:56:34.321378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 430/884] 10.222.0.66 () {62 vars in 1319 bytes} [Fri Jul 29 12:56:34 2022] POST /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:56:34.330102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:34.331839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:34.340145 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:34.342991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:34.344189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:34.344884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:34.594849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:34.604210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:34.607220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:34.608623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-eab76908-5263-4ff7-9f36-6180da41509d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1672 microversion: 2.20 time: 0.283134 Jul 29 12:56:34.609680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 455/885] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:34 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1672 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:35.032486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:35.033087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:35.043211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:35.044027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:35.045140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:35.045764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:35.305296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:35.315186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-707fe303-56ab-4a46-8dab-1ce4bc139bfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.286796 Jul 29 12:56:35.316724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 431/886] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:35.638778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:35.639405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:35.647943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:35.648704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:35.649657 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:35.650283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:35.892777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:35.902382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:35.906809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:35.911070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-992e40ec-bf59-4c86-a240-4349bd69d50b tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.280998 Jul 29 12:56:35.912444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 456/887] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:35 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:36.339639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:36.340914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:36.350911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:36.351652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:36.352668 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:36.353269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:36.575525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-b7964f9e-88b5-4216-a76d-1933a485b066 req-1532ef3c-da52-479c-9f63-3b847825f5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0648f4c1-242e-4fa9-ad53-9f4d24cfe259", "name": "network-vif-plugged", "status": "completed", "tag": "a0eea1bb-4265-4a85-be70-37e7d42b5c16"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:36.580280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:36.592535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3c0d1e22-26cd-4cc4-b1d9-0dbaa502f527 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.255866 Jul 29 12:56:36.592701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-b7964f9e-88b5-4216-a76d-1933a485b066 req-1532ef3c-da52-479c-9f63-3b847825f5d5 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:36.593171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-b7964f9e-88b5-4216-a76d-1933a485b066 req-1532ef3c-da52-479c-9f63-3b847825f5d5 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:36.595789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 432/888] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:36.628245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-b7964f9e-88b5-4216-a76d-1933a485b066 req-1532ef3c-da52-479c-9f63-3b847825f5d5 service nova] Creating event network-vif-plugged:a0eea1bb-4265-4a85-be70-37e7d42b5c16 for instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 on hv-cinder-81914 Jul 29 12:56:36.635522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-b7964f9e-88b5-4216-a76d-1933a485b066 req-1532ef3c-da52-479c-9f63-3b847825f5d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063627 Jul 29 12:56:36.636768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 457/889] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:36.936089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:36.937114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:36.948892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:36.949461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:36.950353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:36.952363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:37.245150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:37.255400 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:37.261513 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:37.262627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a322e257-09c7-4b38-a5f6-3b9b73870f9e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.330345 Jul 29 12:56:37.263634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 433/890] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:36 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:37.618725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:37.619595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:37.628438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:37.628955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:37.629872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:37.630412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:37.841651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:37.860414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fbea022c-4ae2-49bc-992c-689c050e486f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.246997 Jul 29 12:56:37.865909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 458/891] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:38.294860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:38.295715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:38.314457 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:38.317110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:38.318428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:38.319117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:38.573226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:38.589943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:38.594497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:38.600922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-debb9131-9a40-4a8c-9e71-0dfe317f08ce tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.308023 Jul 29 12:56:38.601984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 434/892] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:38 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:38.887521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:38.888135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:38.900432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:38.900906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:38.901970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:38.902407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:39.167264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:39.176175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-72110f68-c9ba-4ea8-a710-4124e786f90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.293203 Jul 29 12:56:39.178098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 459/893] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:39.631470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:39.632073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:39.639443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:39.642392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:39.643229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:39.643814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:39.843950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:39.860084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:39.861614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:39.868044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ebc0bc74-4c85-4453-a144-d920b5cbd679 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.240968 Jul 29 12:56:39.868615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 435/894] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:39 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:40.201288 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:40.203862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:40.213239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:40.213839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:40.215599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:40.216146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:40.378914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:40.388149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-af8f0397-d8c9-4583-9f58-ae39bdca3db1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.192048 Jul 29 12:56:40.398009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 460/895] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:40.893000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:40.893790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:40.900658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:40.901388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:40.902279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:40.902795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:41.190644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:41.199795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:41.201460 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:41.202914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14e2742b-62c7-4f97-91e4-98dfb41a3138 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.313653 Jul 29 12:56:41.203943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 436/896] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:40 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:41.408831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:41.409978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:41.416606 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:41.417248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:41.418224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:41.418661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:41.608204 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:41.617370 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-575ae30e-4fca-431b-94a9-fcfbd46372fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.212334 Jul 29 12:56:41.618330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 461/897] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:42.227568 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:42.228952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:42.249288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:42.250667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:42.251920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:42.252339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:42.510169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:42.520207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:42.521725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:42.525864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7fbcee37-f14a-4465-9084-0336c7bb191d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.302087 Jul 29 12:56:42.566274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 437/898] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:42 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:42.640256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:42.641013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:42.649053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:42.649986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:42.651104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:42.651895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:42.860508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:42.881417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5ce40b60-4ee2-45c3-b87d-388e46e50daf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.244549 Jul 29 12:56:42.882484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 462/899] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:43.576004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:43.577995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:43.587357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:43.588276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:43.589347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:43.590019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:43.773060 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:43.785120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:43.786892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:43.788319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0625da04-73f9-41ef-bf7e-0fdf9c1ec01d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.219843 Jul 29 12:56:43.789082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 438/900] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:43 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:43.903664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:43.905070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:43.914886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:43.915907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:43.916945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:43.917414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:44.097282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:44.106992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6df809ab-cfd9-4936-978e-9ee44f28abca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.207401 Jul 29 12:56:44.107917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 463/901] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:44.819923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:44.820888 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:44.832500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:44.833332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:44.835670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:44.836440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:45.015028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:45.028675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:45.032714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:45.034671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f73bfd7f-d378-455d-9c57-eca2179d94f0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.222023 Jul 29 12:56:45.037029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 439/902] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:44 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:45.136669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:45.137279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:45.145593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:45.146075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:45.146887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:45.147327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:45.374383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:45.378366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:45.389971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-59b27737-8167-4735-8352-e7e4f00119f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.258765 Jul 29 12:56:45.393883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 464/903] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:46.058338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:46.058949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:46.065899 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:46.066547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:46.067321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:46.067758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:46.224744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:46.232480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:46.234508 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:46.236007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ba8f2c50-0acf-41ba-b456-7c29abc03b6e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.181388 Jul 29 12:56:46.237423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 440/904] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:46 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:46.411678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:46.413500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:46.421800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:46.422294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:46.423138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:46.423792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:46.602996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:46.615206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0dfedfaa-2e88-4966-948f-df1eba886112 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.206834 Jul 29 12:56:46.616147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 465/905] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:47.262304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:47.262857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:47.272284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.272743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.273562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.274045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.549585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:47.559179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:47.561101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:47.562299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f659b4d4-c4f9-45c8-8cac-ce999ae2633d tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.306289 Jul 29 12:56:47.562930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 441/906] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:47 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:47.625968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:47.626473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:47.634334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-09a4ba62-7a5c-416d-b39c-e157f7a9060d req-8029a48f-ad1b-4df8-8d8e-d1cf26064a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:47.640877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.641328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.642115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.642547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.653838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-09a4ba62-7a5c-416d-b39c-e157f7a9060d req-8029a48f-ad1b-4df8-8d8e-d1cf26064a14 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.654628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-09a4ba62-7a5c-416d-b39c-e157f7a9060d req-8029a48f-ad1b-4df8-8d8e-d1cf26064a14 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.668035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-09a4ba62-7a5c-416d-b39c-e157f7a9060d req-8029a48f-ad1b-4df8-8d8e-d1cf26064a14 service nova] Creating event network-changed:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:56:47.669893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:56:47.675312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-09a4ba62-7a5c-416d-b39c-e157f7a9060d req-8029a48f-ad1b-4df8-8d8e-d1cf26064a14 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043776 Jul 29 12:56:47.676218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 442/907] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:47.681867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:47.682676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:47.689250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.690042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.691432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.691986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.768542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ba83429a-a0c0-43f9-9fbc-6a68ba93fa58 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 204 len: 0 microversion: 2.1 time: 0.146277 Jul 29 12:56:47.769979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 466/908] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:56:47 2022] DELETE /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:56:47.779788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:47.780918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:47.788003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.788461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.789270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:47.789714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:47.868963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:47.880442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1659509d-051e-4409-b07a-a79f4943bb68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1362 microversion: 2.1 time: 0.202490 Jul 29 12:56:47.894967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 443/909] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:47.975074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:47.984434 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8fea45d9-68c4-40d6-aa8a-c91615f8fb53 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.209683 Jul 29 12:56:47.985126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 467/910] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:47 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:56:48.589095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:48.589800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:48.597261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:48.598825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:48.599825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:48.600267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:48.744823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:48.753711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:48.755283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:48.756710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a6a45311-382f-4c7f-93a2-168d860031c5 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.171597 Jul 29 12:56:48.757193 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 444/911] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:48 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:49.006637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:49.007445 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:49.013449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.013938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.014696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.015131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.067096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:49.067712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:49.073778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.074261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.075023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.075462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.149288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:49.156806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-98b3328c-d355-4169-817a-380e42651265 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.154477 Jul 29 12:56:49.157359 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 445/912] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:49 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:49.206262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:49.213953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9f508b55-ba92-4407-8987-6e0e6d8dac09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1549 microversion: 2.1 time: 0.317296 Jul 29 12:56:49.219554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 468/913] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1549 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:49.239642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:49.240141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:49.246216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.246674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.247435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.247873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.322635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fd383d1a-2a62-4a89-800d-f5466cf27d58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086754 Jul 29 12:56:49.323228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 446/914] 10.222.0.66 () {58 vars in 1275 bytes} [Fri Jul 29 12:56:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:49.780948 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:49.781550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:49.788053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.788499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.789259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:49.789690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:49.933217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:49.941383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:49.943032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:49.944328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3e2308fe-a621-4f41-b27d-0f771eefafa2 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.167312 Jul 29 12:56:49.944983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 469/915] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:49 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:50.179509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:50.180125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:50.186154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:50.186604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:50.187367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:50.187808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:50.304915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-87cefe69-3ebb-4c1b-b929-fd4b17feaa19 req-fbf250b0-9dba-4c82-bd50-61d68bfef533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0648f4c1-242e-4fa9-ad53-9f4d24cfe259", "tag": "a0eea1bb-4265-4a85-be70-37e7d42b5c16"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:50.315710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-87cefe69-3ebb-4c1b-b929-fd4b17feaa19 req-fbf250b0-9dba-4c82-bd50-61d68bfef533 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:50.316255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-87cefe69-3ebb-4c1b-b929-fd4b17feaa19 req-fbf250b0-9dba-4c82-bd50-61d68bfef533 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:50.328042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-87cefe69-3ebb-4c1b-b929-fd4b17feaa19 req-fbf250b0-9dba-4c82-bd50-61d68bfef533 service nova] Creating event network-changed:a0eea1bb-4265-4a85-be70-37e7d42b5c16 for instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 on hv-cinder-81914 Jul 29 12:56:50.333463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-87cefe69-3ebb-4c1b-b929-fd4b17feaa19 req-fbf250b0-9dba-4c82-bd50-61d68bfef533 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Jul 29 12:56:50.334218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 470/916] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:50.352261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:50.359916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-970c7ac7-4d2b-458c-8e4e-f29a525c41eb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.184731 Jul 29 12:56:50.367480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 447/917] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:50 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:50.973949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:50.974544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:50.989421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:50.989977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:50.990822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:50.991325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:51.148059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:51.156391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:51.157905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:51.159119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-40b8a5da-0680-47f5-acdc-bb5067d4f272 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.190318 Jul 29 12:56:51.159672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 471/918] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:50 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:51.380849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:51.381622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:51.384401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:51.390779 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:51.391223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:51.392038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:51.392491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:51.414034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:51.532535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:51.540395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e36ff06d-cb38-4ed3-831a-4c56d47051cc tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.163651 Jul 29 12:56:51.540968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 448/919] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:51 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:52.182342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:52.183198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:52.190886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:52.191659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:52.201952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:52.202889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:52.451146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:52.462292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:52.464107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:52.465596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6514d2aa-751f-4c6f-86fd-1238baaeea3c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.287230 Jul 29 12:56:52.467141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 472/920] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:52 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:52.565414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:52.567430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:52.575858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:52.576877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:52.577909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:52.578561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:52.928291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:52.936647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6339794f-c368-42b7-86f9-e8a1d3379771 tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1569 microversion: 2.1 time: 0.377919 Jul 29 12:56:52.937242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 449/921] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:52 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1569 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:56:53.305218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:53.306372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:53.312947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.313499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.314382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.314899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.340240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5271065c-27cd-457c-b571-37ea973550ef tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.038695 Jul 29 12:56:53.340901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 473/922] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:56:53 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:53.347302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-09fb9ad5-3090-4b0c-9f69-f2b8e3ac9d76 req-7d92d6b4-340e-4eb5-99a9-cc1628058f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfcd2b5-60b2-4174-aecd-50476a218c1f", "name": "network-vif-deleted", "tag": "b3888673-3837-4e1e-8ce0-988166c687be"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:53.367890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-09fb9ad5-3090-4b0c-9f69-f2b8e3ac9d76 req-7d92d6b4-340e-4eb5-99a9-cc1628058f1c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.368344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-09fb9ad5-3090-4b0c-9f69-f2b8e3ac9d76 req-7d92d6b4-340e-4eb5-99a9-cc1628058f1c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.380604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-09fb9ad5-3090-4b0c-9f69-f2b8e3ac9d76 req-7d92d6b4-340e-4eb5-99a9-cc1628058f1c service nova] Creating event network-vif-deleted:b3888673-3837-4e1e-8ce0-988166c687be for instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f on hv-cinder-81914 Jul 29 12:56:53.386031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-09fb9ad5-3090-4b0c-9f69-f2b8e3ac9d76 req-7d92d6b4-340e-4eb5-99a9-cc1628058f1c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043589 Jul 29 12:56:53.387560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 450/923] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:53.490058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:53.490867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:53.497698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.498461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.499324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.499808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.542155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-8790d503-1463-4829-b703-2f141944d6d8 req-dbc5a973-27e8-40c3-a404-568f2d348b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "name": "network-vif-plugged", "status": "completed", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:53.555845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-8790d503-1463-4829-b703-2f141944d6d8 req-dbc5a973-27e8-40c3-a404-568f2d348b5f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.556805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-8790d503-1463-4829-b703-2f141944d6d8 req-dbc5a973-27e8-40c3-a404-568f2d348b5f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.576495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-8790d503-1463-4829-b703-2f141944d6d8 req-dbc5a973-27e8-40c3-a404-568f2d348b5f service nova] Creating event network-vif-plugged:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:56:53.583922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-8790d503-1463-4829-b703-2f141944d6d8 req-dbc5a973-27e8-40c3-a404-568f2d348b5f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047678 Jul 29 12:56:53.584882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 451/924] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:56:53.650986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:53.662533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:53.665337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:53.666666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9192c07c-f1c2-4643-b73b-89299b6cc03e tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.181130 Jul 29 12:56:53.667614 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 474/925] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:53 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:53.958844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:53.959597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:53.966030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.966485 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.967248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.967692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:53.999462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:53.999843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:54.000295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lazy-loading 'fault' on Instance uuid 1bfcd2b5-60b2-4174-aecd-50476a218c1f {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:56:54.045560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c132b2fdc14e7ca4ffb18109a0fa0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c13c269e5f46e1a8236c89377c2171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:54.054139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-afe2f4cf-a46b-4782-81c4-b11cbca104fb tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 200 len: 1225 microversion: 2.1 time: 0.099490 Jul 29 12:56:54.054837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 452/926] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:53 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 12:56:54.696255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:54.696875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:54.703103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:54.703565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:54.704334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:54.704777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:54.738606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b41d6fe6-00c7-46be-9a41-4f645528c438"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:56:54.740938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:54.747422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:54.747874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:54.748652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:54.749092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:54.835845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:54.843826 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:54.845485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:54.847499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e8c018c5-76eb-4729-ae7c-f91aa6747d26 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.155750 Jul 29 12:56:54.848064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 475/927] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:54 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:56:55.076931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:55.077855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] [instance: 1bfcd2b5-60b2-4174-aecd-50476a218c1f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:55.081992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:56:55.087719 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:55.088291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:55.089344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:55.090039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:55.108305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] HTTP exception thrown: Instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f could not be found. Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Request method failure captured: Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f HTTP/1.1 Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49e-dnRXCxLc7WXng7Ah9HG6p8IZZ63S2_pyZmxcWyDKvlz9yTj6xcWxMuQeXqZLvmUKcjw4IjnXSOCzQgZhHn5yPkQx0uEvgynrtTMssFq0KS77YtmGn-bYrDiD76RMq43RTEKLXeCxdYwIWMhuKbvYlGnNTsziMeCPXIcJEF0TWKE Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 13c13c269e5f46e1a8236c89377c2171 Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-TestShelveInstance-525032800 Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:56:55.110325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_13c13c269e5f46e1a8236c89377c2171"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13c13c269e5f46e1a8236c89377c2171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/13c13c269e5f46e1a8236c89377c2171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13c13c269e5f46e1a8236c89377c2171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-TestShelveInstance-525032800 Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 13c13c269e5f46e1a8236c89377c2171 Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-TestShelveInstance-525032800 Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-TestShelveInstance-525032800-project Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: a1c132b2fdc14e7ca4ffb18109a0fa0d Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-TestShelveInstance-525032800-project Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f could not be found. Jul 29 12:56:55.112378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '1bfcd2b5-60b2-4174-aecd-50476a218c1f'} Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f could not be found. Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:56:55.113224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f could not be found. Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f could not be found. Jul 29 12:56:55.114715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:56:55.117958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Returning 404 to user: Instance 1bfcd2b5-60b2-4174-aecd-50476a218c1f could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:56:55.119357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3d238a4c-e957-4f8f-acac-02aaa99d5bbe tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f" status: 404 len: 111 microversion: 2.1 time: 0.046806 Jul 29 12:56:55.120424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 476/928] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:56:55 2022] GET /compute/v2.1/servers/1bfcd2b5-60b2-4174-aecd-50476a218c1f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 12:56:55.268657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d298ff4b-e913-4424-a7fc-bfa78cfa121d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "POST /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533868 Jul 29 12:56:55.269613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 453/929] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:56:54 2022] POST /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 12:56:55.396302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6625d1a5-dc1b-4495-9508-970e7d2abbda tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] Calling method '.version_select at 0x7f74a1e9f790>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:55.432704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6625d1a5-dc1b-4495-9508-970e7d2abbda tempest-TestShelveInstance-525032800 tempest-TestShelveInstance-525032800-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1362500141" status: 202 len: 0 microversion: 2.1 time: 0.044964 Jul 29 12:56:55.433403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 477/930] 10.222.0.66 () {58 vars in 1254 bytes} [Fri Jul 29 12:56:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1362500141 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:56:55.873477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:55.874192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:55.880971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:55.881421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:55.882210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:55.882650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:56.027639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:56.037214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:56.038912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:56.041046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-84e677cd-9712-4f07-96d5-ec3a72aef4a7 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1730 microversion: 2.20 time: 0.172191 Jul 29 12:56:56.041964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 454/931] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:55 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:56:57.075781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:56:57.076552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:56:57.090831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:57.091748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:57.092873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:56:57.094407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:56:57.385333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:57.397073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:57.399260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:56:57.400625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-19d90727-38f7-49b3-b333-4b9b1d4cacf6 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1717 microversion: 2.20 time: 0.339614 Jul 29 12:56:57.401704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 478/932] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:56:57 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1717 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:57:03.059991 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:03.061036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:03.069213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:03.069694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:03.070536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:03.070979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:03.162199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lazy-loading 'services' on Instance uuid cd390942-6c97-4f6f-94c6-e1b8e65773a5 {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:57:03.253870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9a05d4bd-8bf1-4e47-8ec2-7d6be89da663 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments/b41d6fe6-00c7-46be-9a41-4f645528c438" status: 202 len: 0 microversion: 2.1 time: 0.197761 Jul 29 12:57:03.254469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 455/933] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:57:03 2022] DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments/b41d6fe6-00c7-46be-9a41-4f645528c438 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:57:03.263166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:03.265324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:03.274129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:03.274594 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:03.275399 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:03.276294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:03.315539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e37bf406-cadc-46ce-93be-f48a29b2d676 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055725 Jul 29 12:57:03.316976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 479/934] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:57:03 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:04.329725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:04.332615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:04.338967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:04.339422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:04.340188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:04.340626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:04.369097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c6a3b937-7b94-4db6-bb62-d25a354919b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044173 Jul 29 12:57:04.369643 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 456/935] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:57:04 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 12:57:04.429559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:04.430106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:04.436934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:04.437386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:04.438215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:04.438734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:04.464741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:57:04.517009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:57:04.564982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9c47cf53-d8c3-48d9-9bbe-095c34a59a60 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 204 len: 0 microversion: 2.1 time: 0.138512 Jul 29 12:57:04.568840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 480/936] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:57:04 2022] DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 12:57:04.574106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:04.574801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:04.581604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:04.582153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:04.583003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:04.583517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:04.724640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:04.733641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-726c5803-6bf4-49b0-8232-4b313ee4c287 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1681 microversion: 2.1 time: 0.163385 Jul 29 12:57:04.734240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 457/937] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:04 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:57:05.756755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:05.757486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:05.764027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:05.764483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:05.765246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:05.765688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:05.898981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:05.907346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1d4eb3cb-b163-4ee5-a598-6f68123d1aa0 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1681 microversion: 2.1 time: 0.155433 Jul 29 12:57:05.907919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 481/938] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:05 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:57:06.932070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:06.932819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:06.939840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:06.940269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:06.941029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:06.941469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:07.030547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d57a4e83ab4310b5b3ba90f43c5ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57fc58eac4149e780e4329e87582260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:07.039231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ba4d2971-e459-4697-bfc0-89ba6c890d8d tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 200 len: 1613 microversion: 2.1 time: 0.111038 Jul 29 12:57:07.049966 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 458/939] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:06 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:57:07.295529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-01e5f82e-ad71-417f-a89b-ec14d7749f76 req-0dae5c66-78c4-49c7-ae47-910ce3d4c281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd390942-6c97-4f6f-94c6-e1b8e65773a5", "name": "network-vif-deleted", "tag": "70ca365d-1578-470d-808a-db14aa6b382b"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:57:07.309779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-01e5f82e-ad71-417f-a89b-ec14d7749f76 req-0dae5c66-78c4-49c7-ae47-910ce3d4c281 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:07.310350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-01e5f82e-ad71-417f-a89b-ec14d7749f76 req-0dae5c66-78c4-49c7-ae47-910ce3d4c281 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:07.323185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-01e5f82e-ad71-417f-a89b-ec14d7749f76 req-0dae5c66-78c4-49c7-ae47-910ce3d4c281 service nova] Creating event network-vif-deleted:70ca365d-1578-470d-808a-db14aa6b382b for instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 on hv-cinder-81914 Jul 29 12:57:07.329088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-01e5f82e-ad71-417f-a89b-ec14d7749f76 req-0dae5c66-78c4-49c7-ae47-910ce3d4c281 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Jul 29 12:57:07.329915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 482/940] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:08.060724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:08.061335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:08.068699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:08.069152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:08.069960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:08.070404 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:08.084690 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 HTTP/1.1 Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:08.086393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:08.087976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'cd390942-6c97-4f6f-94c6-e1b8e65773a5'} Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:08.088947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:08.090588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:08.091859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:08.091859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8a922768-8fd3-4e94-a91a-203007ba17db tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 404 len: 111 microversion: 2.1 time: 0.031108 Jul 29 12:57:08.094082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 459/941] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:08 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:08.098319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c4fe08b6-31b7-4f68-9583-91441db8a7b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '.version_select at 0x7f74a1e4eee0>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:08.125040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c4fe08b6-31b7-4f68-9583-91441db8a7b6 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986082360" status: 202 len: 0 microversion: 2.1 time: 0.030900 Jul 29 12:57:08.125206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 483/942] 10.222.0.66 () {58 vars in 1218 bytes} [Fri Jul 29 12:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986082360 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 12:57:09.918290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:09.919625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:09.929009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:09.929472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:09.930313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:09.930744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:09.944443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 HTTP/1.1 Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:09.946075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.947632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'cd390942-6c97-4f6f-94c6-e1b8e65773a5'} Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:09.948512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.949727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.951536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:09.951536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2155d593-d5ac-4bd0-8150-d23e9d404f19 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 404 len: 111 microversion: 2.1 time: 0.033273 Jul 29 12:57:09.951536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 460/943] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:57:09 2022] DELETE /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:09.957515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:09.958403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: cd390942-6c97-4f6f-94c6-e1b8e65773a5] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:09.965603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:09.965903 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:09.966680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:09.967110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:09.981925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 HTTP/1.1 Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:09.983554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.985017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': 'cd390942-6c97-4f6f-94c6-e1b8e65773a5'} Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:09.985848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. Jul 29 12:57:09.987757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:09.988898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance cd390942-6c97-4f6f-94c6-e1b8e65773a5 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:09.988898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1907f7ea-4cae-4e56-846b-7f276c8c493a tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5" status: 404 len: 111 microversion: 2.1 time: 0.031901 Jul 29 12:57:09.988898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 484/944] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:09 2022] GET /compute/v2.1/servers/cd390942-6c97-4f6f-94c6-e1b8e65773a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:11.131794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:11.132315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:11.139230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.139697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.140467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.140911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.157630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 HTTP/1.1 Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:11.159813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.161680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9'} Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:11.163336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.164577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.166219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:11.166219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-af21d90b-66c9-4b03-800d-ef58767ed4eb tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 404 len: 111 microversion: 2.1 time: 0.033857 Jul 29 12:57:11.166219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 461/945] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:57:11 2022] DELETE /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:11.170500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:11.171122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:11.177703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.178198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.178965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.179431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.192501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 HTTP/1.1 Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:11.194036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.195619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9'} Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:11.196642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. Jul 29 12:57:11.198144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.199611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance 2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:11.199611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e27c224a-a2dd-4072-a5ba-00b007f34992 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9" status: 404 len: 111 microversion: 2.1 time: 0.028776 Jul 29 12:57:11.199611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 485/946] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:11 2022] GET /compute/v2.1/servers/2b1d7eb6-1cf6-48c1-96a0-a28d046c74e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:11.203894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:11.204392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:11.210937 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.211392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.212159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.212600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.227320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d HTTP/1.1 Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:11.228886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.230623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'b1159bd7-b7c9-4745-b0c5-9c5207d8291d'} Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:11.231545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.232882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.234142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:11.234142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-05115308-a04d-4c71-bb71-14468fccc162 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 404 len: 111 microversion: 2.1 time: 0.030335 Jul 29 12:57:11.234142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 462/947] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:57:11 2022] DELETE /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:11.238919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:11.239566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: b1159bd7-b7c9-4745-b0c5-9c5207d8291d] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:11.245727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.246216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.246975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:11.247416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:11.264422 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d HTTP/1.1 Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:11.265968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.267666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': 'b1159bd7-b7c9-4745-b0c5-9c5207d8291d'} Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:11.268645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. Jul 29 12:57:11.270171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:11.271660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance b1159bd7-b7c9-4745-b0c5-9c5207d8291d could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:11.271660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c693fcba-a494-4e61-9b42-4040cf3863c1 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d" status: 404 len: 111 microversion: 2.1 time: 0.032251 Jul 29 12:57:11.271660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 486/948] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:11 2022] GET /compute/v2.1/servers/b1159bd7-b7c9-4745-b0c5-9c5207d8291d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:12.409677 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:12.410205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:12.416694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:12.417142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:12.417960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:12.418402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:12.431763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f HTTP/1.1 Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:12.433330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.434962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': 'ef6fb941-1056-4618-8fd5-22dd72cf944f'} Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:12.435998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.437543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.439160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:12.439160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b85f9a98-0cb7-4213-8cf8-20982b2c1df4 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 404 len: 111 microversion: 2.1 time: 0.029625 Jul 29 12:57:12.439160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 463/949] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 12:57:12 2022] DELETE /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:12.443114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:12.443702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] [instance: ef6fb941-1056-4618-8fd5-22dd72cf944f] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:12.450519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:12.450967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:12.451734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:12.452166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:12.466047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] HTTP exception thrown: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Request method failure captured: Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f HTTP/1.1 Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eST81BT-KBSuNFSbNQthHEkp-Xz1JDEEoCiTtuAC4bG5wAc2VhjwIfPjrzOVkvEwb7zKBKEyrP1u_JWLS-bAYP6S3Xt2IBeaKdr0TGRy3FGFMNiyUmoXVzWCuXiGXf01mSeRu4IX_y9931joPqwW4TXnSZZI_y5TA4fAGaxOTS4zM Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:12.467554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d57fc58eac4149e780e4329e87582260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d57fc58eac4149e780e4329e87582260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d57fc58eac4149e780e4329e87582260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: d57fc58eac4149e780e4329e87582260 Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1065141143 Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: b4d57a4e83ab4310b5b3ba90f43c5ddc Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeNegativeTest-1065141143-project Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.469157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': 'ef6fb941-1056-4618-8fd5-22dd72cf944f'} Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:12.470044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. Jul 29 12:57:12.472353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:12.473712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] Returning 404 to user: Instance ef6fb941-1056-4618-8fd5-22dd72cf944f could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:12.473712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-278432ab-1672-4502-9eee-ed2acb252f25 tempest-AttachVolumeNegativeTest-1065141143 tempest-AttachVolumeNegativeTest-1065141143-project] 10.222.0.66 "GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f" status: 404 len: 111 microversion: 2.1 time: 0.029685 Jul 29 12:57:12.473712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 487/950] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 12:57:12 2022] GET /compute/v2.1/servers/ef6fb941-1056-4618-8fd5-22dd72cf944f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 12:57:33.724525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:33.725064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:33.727300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=33 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:57:33.728047 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:57:33.733739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:33.734223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:33.734994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:33.735440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:33.759641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ae99a50d-03b7-4673-9ccb-d61abe25beaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/ips" status: 200 len: 147 microversion: 2.1 time: 0.039738 Jul 29 12:57:33.760205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 464/951] 10.222.0.66 () {58 vars in 1248 bytes} [Fri Jul 29 12:57:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:35.087371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5863b596-bd03-4295-8a25-cb0299a8e813"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:57:35.089750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:35.092165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:57:35.092932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=16 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:57:35.099331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:35.099791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:35.100554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:35.100995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:35.352246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-324dd008-08f6-4212-8779-01f9c2feb09b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268982 Jul 29 12:57:35.353011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 488/952] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:57:35 2022] POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:37.758451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:37.760698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:37.767022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:37.767475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:37.768242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:37.768684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:37.796460 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-32c92351-25f7-4651-a460-a47f4b86b371 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041916 Jul 29 12:57:37.797043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 465/953] 10.222.0.66 () {60 vars in 1343 bytes} [Fri Jul 29 12:57:37 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 12:57:37.859306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:37.859907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:37.866750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:37.867201 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:37.867961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:37.868397 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:37.893208 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 12:57:37.971158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-efa9fb6b-af9b-4a6c-bd4c-5b97f8fef843 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 204 len: 0 microversion: 2.20 time: 0.116157 Jul 29 12:57:37.972251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 489/954] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Jul 29 12:57:37 2022] DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 12:57:37.981147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:37.981751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:37.988645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:37.989108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:37.989917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:37.990366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:38.126345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:38.134721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:38.136230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:38.137428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4fc5dc16-8d40-4cd6-88b5-f53e879452e0 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.160522 Jul 29 12:57:38.138231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 466/955] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:57:37 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:57:39.161630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:39.162355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:39.168728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:39.169192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:39.169990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:39.170434 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:39.308053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:39.316407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:39.318004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:39.319197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8c3eaa22-12b0-4b8e-b0a9-0970e03dae60 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1723 microversion: 2.20 time: 0.161772 Jul 29 12:57:39.319772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 490/956] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:57:39 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 12:57:40.241920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-89d7a322-05f9-461b-8416-4ffde71ea663 req-1cebf732-fd25-434c-b4f7-52478a8a67ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d409fe-072b-4bec-975c-fc10d69ee0a2", "name": "network-vif-deleted", "tag": "d4b42add-8dac-445c-be44-2b87de13c027"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:57:40.254256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-89d7a322-05f9-461b-8416-4ffde71ea663 req-1cebf732-fd25-434c-b4f7-52478a8a67ab service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:40.254704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-89d7a322-05f9-461b-8416-4ffde71ea663 req-1cebf732-fd25-434c-b4f7-52478a8a67ab service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:40.268542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-89d7a322-05f9-461b-8416-4ffde71ea663 req-1cebf732-fd25-434c-b4f7-52478a8a67ab service nova] Creating event network-vif-deleted:d4b42add-8dac-445c-be44-2b87de13c027 for instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 on hv-cinder-81914 Jul 29 12:57:40.274247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-89d7a322-05f9-461b-8416-4ffde71ea663 req-1cebf732-fd25-434c-b4f7-52478a8a67ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036487 Jul 29 12:57:40.275021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 467/957] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:40.346118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:40.348006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:40.357190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:40.358335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:40.359531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:40.360260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:40.411231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:40.412716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:40.413364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lazy-loading 'fault' on Instance uuid 50d409fe-072b-4bec-975c-fc10d69ee0a2 {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:57:40.474525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:40.486489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:40.488400 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7ee2c3480f8483bb76ecc686215720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89441418bb3d4ff6ad1a0b466e69cfb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 12:57:40.489751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-50c082e8-2cb4-4f3f-852f-36b88a8e9e00 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 200 len: 1371 microversion: 2.20 time: 0.148997 Jul 29 12:57:40.491626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 491/958] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:57:40 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 12:57:41.514770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:41.515461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:41.521707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:41.522191 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:41.522980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:41.523425 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:41.538021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] HTTP exception thrown: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Request method failure captured: Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 HTTP/1.1 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eTFRgGbWfNrlwM7cnKYargSzBwedC0koS6a-H581aUEPO7MPgt74a3lpfgSbLUMSHQNemDd0pwtl9Q48pf1Ps06KWk8B0q_Ik2E7_A7zkTsIl01qaECrl_D0g0zQCikOtspuPvLhBM4qXZ6qxmi8gWhzWGo8SQ-ZcNasNZg6h2-XE Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:41.539664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: e7ee2c3480f8483bb76ecc686215720b Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:41.541480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '50d409fe-072b-4bec-975c-fc10d69ee0a2'} Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:41.542429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:41.543956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:41.545299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Returning 404 to user: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:41.545299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3e142066-fbea-4a95-b7cd-c4b5d0da5c24 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 404 len: 111 microversion: 2.20 time: 0.031129 Jul 29 12:57:41.545299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 468/959] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:57:41 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:57:41.552103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b6946c00-a396-4647-a55c-b3b28f3fc74a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '.version_select at 0x7f74a1e4e670>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:41.570917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b6946c00-a396-4647-a55c-b3b28f3fc74a tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190335846" status: 204 len: 0 microversion: 2.20 time: 0.023703 Jul 29 12:57:41.571477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 492/960] 10.222.0.66 () {60 vars in 1262 bytes} [Fri Jul 29 12:57:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190335846 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 12:57:41.898352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:41.900596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:41.906748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:41.907232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:41.908003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:41.908471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:41.938599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-50dbb705-402a-4673-9ad7-c6a9d67a8f97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Jul 29 12:57:41.939351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 469/961] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:57:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:41.949917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:41.950496 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:41.957080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:41.957529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:41.958396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:41.958777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:41.989804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-45aebca3-bf3e-47c4-863a-2d25ebfe57f9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/5863b596-bd03-4295-8a25-cb0299a8e813" status: 200 len: 194 microversion: 2.1 time: 0.043839 Jul 29 12:57:41.990413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 493/962] 10.222.0.66 () {58 vars in 1413 bytes} [Fri Jul 29 12:57:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/5863b596-bd03-4295-8a25-cb0299a8e813 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:43.380181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8826718-c30b-41fd-ac04-717d364db0fa"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 12:57:43.383144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:43.389223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:43.389524 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:43.392044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:43.392044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:43.407869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:43.408380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:43.414938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:43.415390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:43.416187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:43.416629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:43.430328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] HTTP exception thrown: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Request method failure captured: Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 HTTP/1.1 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eTFRgGbWfNrlwM7cnKYargSzBwedC0koS6a-H581aUEPO7MPgt74a3lpfgSbLUMSHQNemDd0pwtl9Q48pf1Ps06KWk8B0q_Ik2E7_A7zkTsIl01qaECrl_D0g0zQCikOtspuPvLhBM4qXZ6qxmi8gWhzWGo8SQ-ZcNasNZg6h2-XE Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:43.432061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: e7ee2c3480f8483bb76ecc686215720b Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.433796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '50d409fe-072b-4bec-975c-fc10d69ee0a2'} Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:43.434711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.436250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.437727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Returning 404 to user: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:43.437727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cc8967f7-b900-45ab-9784-d49a72846301 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 404 len: 111 microversion: 2.20 time: 0.029607 Jul 29 12:57:43.437727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 494/963] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Jul 29 12:57:43 2022] DELETE /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 12:57:43.442291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:43.442898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 50d409fe-072b-4bec-975c-fc10d69ee0a2] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:43.448685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:43.449153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:43.449934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:43.450376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:43.464485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] HTTP exception thrown: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Request method failure captured: Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 HTTP/1.1 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eTFRgGbWfNrlwM7cnKYargSzBwedC0koS6a-H581aUEPO7MPgt74a3lpfgSbLUMSHQNemDd0pwtl9Q48pf1Ps06KWk8B0q_Ik2E7_A7zkTsIl01qaECrl_D0g0zQCikOtspuPvLhBM4qXZ6qxmi8gWhzWGo8SQ-ZcNasNZg6h2-XE Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:43.466058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: e7ee2c3480f8483bb76ecc686215720b Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.467721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '50d409fe-072b-4bec-975c-fc10d69ee0a2'} Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:43.468626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. Jul 29 12:57:43.470320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:43.471624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Returning 404 to user: Instance 50d409fe-072b-4bec-975c-fc10d69ee0a2 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:43.471624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a72213c0-aedc-497b-ad51-1cc8c6ec5068 tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2" status: 404 len: 111 microversion: 2.20 time: 0.029320 Jul 29 12:57:43.471624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 495/964] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:57:43 2022] GET /compute/v2.1/servers/50d409fe-072b-4bec-975c-fc10d69ee0a2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 12:57:43.645343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-38cd29a3-797c-4e3b-a6cd-df028c68b55b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269947 Jul 29 12:57:43.649890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 470/965] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 12:57:43 2022] POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:57:44.619908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:44.620440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:44.627775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:44.628233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:44.629017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:44.629462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:44.643806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] HTTP exception thrown: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Request method failure captured: Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb HTTP/1.1 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49eTFRgGbWfNrlwM7cnKYargSzBwedC0koS6a-H581aUEPO7MPgt74a3lpfgSbLUMSHQNemDd0pwtl9Q48pf1Ps06KWk8B0q_Ik2E7_A7zkTsIl01qaECrl_D0g0zQCikOtspuPvLhBM4qXZ6qxmi8gWhzWGo8SQ-ZcNasNZg6h2-XE Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 12:57:44.645403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: e7ee2c3480f8483bb76ecc686215720b Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.647236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '9a58e30f-f1a3-4c6b-8b99-00a393888dfb'} Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:44.648167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.649687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.651275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Returning 404 to user: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:44.651275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-554198db-7938-4c46-9def-f544907a1cfc tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 404 len: 111 microversion: 2.20 time: 0.030873 Jul 29 12:57:44.651275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 496/966] 10.222.0.66 () {60 vars in 1280 bytes} [Fri Jul 29 12:57:44 2022] DELETE /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:57:44.660682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:57:44.661384 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] [instance: 9a58e30f-f1a3-4c6b-8b99-00a393888dfb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:57:44.668740 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:44.669192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:44.669999 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:57:44.670442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:57:44.685199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] HTTP exception thrown: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Request method failure captured: Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb HTTP/1.1 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49eTFRgGbWfNrlwM7cnKYargSzBwedC0koS6a-H581aUEPO7MPgt74a3lpfgSbLUMSHQNemDd0pwtl9Q48pf1Ps06KWk8B0q_Ik2E7_A7zkTsIl01qaECrl_D0g0zQCikOtspuPvLhBM4qXZ6qxmi8gWhzWGo8SQ-ZcNasNZg6h2-XE Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 12:57:44.687127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/89441418bb3d4ff6ad1a0b466e69cfb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 89441418bb3d4ff6ad1a0b466e69cfb6 Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-601442670 Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: e7ee2c3480f8483bb76ecc686215720b Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeShelveTestJSON-601442670-project Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.689395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '9a58e30f-f1a3-4c6b-8b99-00a393888dfb'} Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 12:57:44.690308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. Jul 29 12:57:44.692300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 12:57:44.693451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] Returning 404 to user: Instance 9a58e30f-f1a3-4c6b-8b99-00a393888dfb could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 12:57:44.693451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-24856d9c-dd6f-4718-abd3-374f39b0d03c tempest-AttachVolumeShelveTestJSON-601442670 tempest-AttachVolumeShelveTestJSON-601442670-project] 10.222.0.66 "GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb" status: 404 len: 111 microversion: 2.20 time: 0.033090 Jul 29 12:57:44.693451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 471/967] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 29 12:57:44 2022] GET /compute/v2.1/servers/9a58e30f-f1a3-4c6b-8b99-00a393888dfb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 12:58:37.785672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:58:37.785672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:58:37.785672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:58:37.785672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:58:37.786626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:58:37.787071 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:58:37.787839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:58:37.788270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:58:37.821707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3b6fd9ec-cf1a-4a4c-b667-55eca867fd73 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050521 Jul 29 12:58:37.822372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 497/968] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 12:58:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:58:37.987612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:58:37.988208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:58:37.990527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=16 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:58:37.991178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 12:58:37.997385 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:58:37.997860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:58:37.998644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:58:37.999578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:58:38.032039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4c3a1db7-31c5-4b5c-8d6c-9b3ef40133dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/5863b596-bd03-4295-8a25-cb0299a8e813" status: 200 len: 194 microversion: 2.1 time: 0.048483 Jul 29 12:58:38.032819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 472/969] 10.222.0.66 () {58 vars in 1413 bytes} [Fri Jul 29 12:58:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/5863b596-bd03-4295-8a25-cb0299a8e813 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 12:58:38.043035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 12:58:38.043729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 12:58:38.050355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:58:38.050802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:58:38.051758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 12:58:38.052216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 12:58:38.141761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lazy-loading 'services' on Instance uuid 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 12:58:38.215161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bdf926b3-7bdc-4291-95c3-745fd20cc4dc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/5863b596-bd03-4295-8a25-cb0299a8e813" status: 202 len: 0 microversion: 2.1 time: 0.175999 Jul 29 12:58:38.215902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 498/970] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 12:58:38 2022] DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/5863b596-bd03-4295-8a25-cb0299a8e813 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 12:58:48.113262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 12:58:48.113934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 12:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:00:29.055044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:00:29.055784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:00:43.585169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:00:43.585791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:00:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:00:53.254397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:00:53.254939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:00:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:01:48.603282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:01:48.604478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:02:08.121792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:02:08.122319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:02:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:02:11.479090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:02:11.479584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:03:49.063994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:03:49.064496 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:04:03.595005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:04:03.595666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:04:13.263381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:04:13.263896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:04:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:04:38.825519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76004ffb-65f1-4920-bae8-fe0ef9fac084] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 13:04:38.826153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:04:38.826837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:04:38.831571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:38.832066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:38.839341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:38.839801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:38.840572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:38.841019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:39.121523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lazy-loading 'services' on Instance uuid 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 13:04:39.193954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ddd91375-987a-4285-b1e9-8af9ff3d93e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/f8826718-c30b-41fd-ac04-717d364db0fa" status: 202 len: 0 microversion: 2.1 time: 0.371052 Jul 29 13:04:39.194533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 473/971] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 13:04:38 2022] DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments/f8826718-c30b-41fd-ac04-717d364db0fa => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 13:04:39.201686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR oslo.messaging._drivers.impl_rabbit [-] [352bdc36-01b7-488f-81fb-dca14cfc664d] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 13:04:39.202284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=4 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:04:39.203185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:04:39.207708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:39.210091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:39.218713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:39.219164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:39.219943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:39.220385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:39.256761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1943b809-5225-4596-adec-946adfcf5489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057099 Jul 29 13:04:39.257813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 499/972] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:40.274421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:40.276755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:40.284618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] [76004ffb-65f1-4920-bae8-fe0ef9fac084] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 60906. Jul 29 13:04:40.286168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:40.286627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:40.287434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:40.287910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:40.321054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5261be50-111b-4bdc-aeb3-8e2353590e36 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053674 Jul 29 13:04:40.321605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 474/973] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:41.335432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:41.338229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:41.348192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:41.348642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:41.349395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:41.349849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:41.353504 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] [352bdc36-01b7-488f-81fb-dca14cfc664d] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 60916. Jul 29 13:04:41.381273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-97c2f9a0-587a-47e6-9ab4-7453588c45c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049819 Jul 29 13:04:41.381751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 500/974] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:42.393635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:42.395823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:42.402314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:42.402791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:42.403555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:42.403996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:42.434983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6a86d73e-b810-46d5-9e30-2060e62f8aac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045219 Jul 29 13:04:42.435954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 475/975] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:43.448211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:43.450393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:43.456868 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:43.457325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:43.458111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:43.458553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:43.487169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-df2509dd-259f-40a8-bdbc-730a664eca22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043539 Jul 29 13:04:43.487707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 501/976] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:44.499541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:44.501720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:44.508326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:44.508781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:44.509542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:44.510015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:44.540248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c9291b56-0624-40e0-ac5b-530c1bfa603f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044696 Jul 29 13:04:44.540789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 476/977] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:45.552011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:45.554081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:45.560703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:45.561172 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:45.561956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:45.562389 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:45.592161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8433efda-024d-44f2-b4da-5b86242a8213 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044207 Jul 29 13:04:45.592701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 502/978] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:46.605285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:46.607488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:46.613933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:46.614386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:46.615154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:46.615598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:46.645025 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-00d17ca5-286e-4a6d-baa3-871b845bce5e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044580 Jul 29 13:04:46.645561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 477/979] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:47.657647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:47.659857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:47.666844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:47.667299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:47.668060 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:47.668497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:47.698316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-56b678d0-27a1-4bcc-8797-575139ac330f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044760 Jul 29 13:04:47.698854 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 503/980] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:48.710148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:48.712933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:48.719431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:48.719887 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:48.720943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:48.721417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:48.750739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-117e315a-c273-4175-b585-d2ac5e358e4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044580 Jul 29 13:04:48.751283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 478/981] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:49.763749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:49.765858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:49.772545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:49.773000 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:49.774428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:49.774872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:49.804496 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ea52fb86-9a61-4807-9547-aaf8392b3ce7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045021 Jul 29 13:04:49.805047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 504/982] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:50.818141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:50.820933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:50.827589 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:50.828043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:50.828804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:50.829242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:50.859491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-70d7c8e2-7d55-4018-bb7e-80207c88fc82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045314 Jul 29 13:04:50.860031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 479/983] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:51.872361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:51.874579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:51.881013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:51.881462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:51.882259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:51.883252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:51.912410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fd28bf6f-c20c-4445-af30-4ac522a5d3f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044098 Jul 29 13:04:51.912956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 505/984] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:52.924718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:52.926816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:52.933880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:52.934338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:52.935106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:52.935548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:52.964643 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-28360223-ef72-4032-ad96-46e34076a38e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043985 Jul 29 13:04:52.965185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 480/985] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:53.976915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:53.979004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:53.985720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:53.986196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:53.986950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:53.987381 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:54.016688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9a070723-d864-441f-80d2-7abc58e5d58b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043761 Jul 29 13:04:54.017229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 506/986] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:55.029604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:55.031707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:55.038876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:55.039335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:55.040124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:55.040563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:55.076487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-796409e4-8a89-49c1-b5a4-09fd933b1efa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050940 Jul 29 13:04:55.077051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 481/987] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:56.089019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:56.091266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:56.097856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:56.098311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:56.099085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:56.099527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:56.129962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c1aaeeeb-5980-4dc7-8794-66ee4fec6d48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045159 Jul 29 13:04:56.130528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 507/988] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:57.142649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:57.144786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:57.151340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:57.151784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:57.152538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:57.152969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:57.182318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-91e046fb-c49c-43d0-9c01-cd1419396cd2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043729 Jul 29 13:04:57.182794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 482/989] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:58.194304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:58.197088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:58.203543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:58.203994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:58.204763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:58.205199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:58.235106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2f2ca852-029e-4868-a3da-79a4ce7352c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044703 Jul 29 13:04:58.235585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 508/990] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:04:59.247904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:04:59.250107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:04:59.256545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:59.256993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:59.257744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:04:59.258205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:04:59.287026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-86fad36e-79bf-4c79-942a-f83e7a5dbb6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043058 Jul 29 13:04:59.287566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 483/991] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:04:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:00.299610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:00.301798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:00.309057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:00.309512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:00.310314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:00.310757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:00.341039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0b45c871-8dd5-4fa4-8835-14c7422cd7f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045377 Jul 29 13:05:00.341613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 509/992] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:01.353712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:01.356138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:01.362693 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:01.363149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:01.363913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:01.364352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:01.392657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-36a8664a-4ac8-47ab-94e7-1a2f29d1e216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043442 Jul 29 13:05:01.393136 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 484/993] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:02.405121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:02.407341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:02.413773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:02.414255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:02.415015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:02.415450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:02.443668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-303cc344-022c-46fc-a357-f753111f88a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042528 Jul 29 13:05:02.444200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 510/994] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:03.456316 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:03.458501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:03.464963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:03.465422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:03.466230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:03.466673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:03.496016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a61da1e6-4594-476b-9c6b-3bbfc8c0b3df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043708 Jul 29 13:05:03.496569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 485/995] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:04.508125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:04.510299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:04.516957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:04.517407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:04.518228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:04.518663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:04.548566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-711d0a96-4404-4ce3-ace5-0e4d0c6771b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044330 Jul 29 13:05:04.549111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 511/996] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:05.561328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:05.563518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:05.569626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:05.570179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:05.570951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:05.571393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:05.600003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7919f493-73a2-4fff-9ca5-938acebb740b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042747 Jul 29 13:05:05.600555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 486/997] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:06.612493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:06.614658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:06.621757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:06.622241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:06.623014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:06.623453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:06.656299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8efce464-0bd3-4d20-8046-2fece1be3a60 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047570 Jul 29 13:05:06.656898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 512/998] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:07.668860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:07.671129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:07.677599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:07.678174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:07.678951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:07.679398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:07.709220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f26721f2-c1f5-4591-971a-99bbe83a5e55 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044362 Jul 29 13:05:07.709783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 487/999] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:08.612049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:05:08.612303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:05:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:05:08.723732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:08.725934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:08.734473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:08.734935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:08.736178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:08.736178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:08.768897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-08cfef4f-527e-4c0f-be7b-791a98d2ea09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050761 Jul 29 13:05:08.773460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 513/1000] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:09.784059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:09.787248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:09.791296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=31 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:09.799096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:09.799768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:09.801138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:09.801583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:09.807414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:09.840978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1bd0db6e-5f7f-45f6-8128-00e42b679749 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063346 Jul 29 13:05:09.841557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 488/1001] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:10.854017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:10.856673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:10.859262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=31 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:10.865751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:10.866235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:10.867588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:10.869386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:10.872414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=91 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:10.898600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-53400dad-d8d0-4801-b262-8f5393f6bae6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049763 Jul 29 13:05:10.899170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 514/1002] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:11.911017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:11.913199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:11.919509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:11.919962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:11.920723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:11.921160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:11.952609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7ca2aef2-1b04-4468-976c-864fd5c3c9b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045573 Jul 29 13:05:11.953180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 489/1003] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:12.966242 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:12.968376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:12.974536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:12.974980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:12.975733 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:12.976190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:13.005701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9d50d7c7-8066-471a-a80a-458899b3ee3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043490 Jul 29 13:05:13.006303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 515/1004] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:14.017872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:14.020075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:14.026647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:14.027095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:14.027854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:14.028289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:14.056895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c515d101-3e02-4988-b1ec-e6e1d4950438 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043051 Jul 29 13:05:14.057429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 490/1005] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:15.069141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:15.071931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:15.078743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:15.079197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:15.079964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:15.080406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:15.111294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9b739940-98a5-4279-a866-631a94812ac5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045872 Jul 29 13:05:15.111886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 516/1006] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:16.123729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:16.125927 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:16.132975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:16.133430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:16.134227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:16.134671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:16.166505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f1813c00-f529-48b4-9596-1114ef00af2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046771 Jul 29 13:05:16.167302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 491/1007] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:17.179258 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:17.181451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:17.187877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:17.188323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:17.189075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:17.189506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:17.218272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-06c5269f-8bb8-4570-8351-865090d96b95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043064 Jul 29 13:05:17.218810 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 517/1008] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:18.231127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:18.233395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:18.239919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:18.240380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:18.241169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:18.241742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:18.271197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6492e844-ef2f-44cd-b53b-bb95c25daca6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044362 Jul 29 13:05:18.271773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 492/1009] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:19.284468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:19.286647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:19.294000 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:19.294477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:19.295306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:19.295750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:19.324750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8889bd85-f42a-46d4-adba-3393b9673bdd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044515 Jul 29 13:05:19.325336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 518/1010] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:20.337101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:20.339359 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:20.345853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:20.346317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:20.347112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:20.347570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:20.377370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c14666b3-ffc7-4546-9e6a-a1203f905144 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044213 Jul 29 13:05:20.377862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 493/1011] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:21.389713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:21.391826 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:21.398412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:21.398865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:21.399630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:21.400066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:21.429940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-502186d5-ba7d-404e-9b3d-abe66f094621 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043670 Jul 29 13:05:21.430493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 519/1012] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:22.442716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:22.444850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:22.451406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:22.451860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:22.452629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:22.453071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:22.483405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-19090d47-6db5-4505-b64f-8dadac38d448 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045094 Jul 29 13:05:22.483971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 494/1013] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:23.496361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:23.498473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:23.505320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:23.505779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:23.506573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:23.507580 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:23.537388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2a65dba7-1eb5-49cc-8830-ae42676a22a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045516 Jul 29 13:05:23.537973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 520/1014] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:24.550157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:24.552233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:24.559284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:24.559741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:24.560539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:24.560982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:24.590290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-02f5cdfd-b157-4045-87c8-35573fe6766f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044168 Jul 29 13:05:24.590845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 495/1015] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:25.603227 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:25.605815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:25.612524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:25.613028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:25.613919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:25.614469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:25.650507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7f6a3da1-2a94-4c4b-91a6-02b710badb5c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051832 Jul 29 13:05:25.651069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 521/1016] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:26.662827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:26.665543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:26.672016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:26.672410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:26.673171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:26.673606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:26.703030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d6fe9ed9-6949-4d8a-b88d-385ae2cb6775 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044107 Jul 29 13:05:26.703565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 496/1017] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:27.716211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:27.718395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:27.724906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:27.725364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:27.726749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:27.727193 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:27.757136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7cb41411-237d-4184-bbc8-372963b82384 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045026 Jul 29 13:05:27.757784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 522/1018] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:28.130199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:05:28.130375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:05:28.769614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:28.771798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:28.778367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:28.778825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:28.779605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:28.780034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:28.810030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-64bd4bc8-fbe3-4bc5-a2af-1a568bf79e6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044362 Jul 29 13:05:28.810576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 497/1019] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:29.822281 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:29.824460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:29.830921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:29.831386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:29.832186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:29.832629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:29.864630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1748f543-cb06-47ea-a8d9-1e9d5555f47b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046317 Jul 29 13:05:29.865113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 523/1020] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:30.878841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:30.880982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:30.888149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:30.888606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:30.889373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:30.889837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:30.919123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a67d19de-8488-471f-a990-62d469788f5a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044310 Jul 29 13:05:30.919675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 498/1021] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:31.487224 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:05:31.487433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:05:31.932361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:31.934562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:31.942444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:31.942902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:31.943668 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:31.944114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:31.973392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-782a0361-6155-4953-b70b-c979f1427269 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045901 Jul 29 13:05:31.973890 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 524/1022] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:32.986320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:32.988449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:32.995087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:32.995538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:32.996302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:32.996742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:33.030392 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a776a939-122b-4438-a446-45a79a636da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048571 Jul 29 13:05:33.031628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 499/1023] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:34.042857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:34.045044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:34.051566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:34.052024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:34.052790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:34.053232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:34.083001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1fdbaad8-14dc-4958-8b70-3df5aa7af97e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044594 Jul 29 13:05:34.083643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 525/1024] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:35.096223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:35.098611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:35.105655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:35.106269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:35.107135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:35.107610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:35.140962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e77c2cc7-b8be-49c0-845d-d63cf0b5b1c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048758 Jul 29 13:05:35.141712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 500/1025] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:36.153494 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:36.155660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:36.162098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:36.162543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:36.163835 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:36.164266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:36.194285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ab9df144-7b4c-439b-882d-3e189c427489 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044675 Jul 29 13:05:36.194855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 526/1026] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:37.206155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:37.208357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:37.215417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:37.215873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:37.216760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:37.217204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:37.247211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d0372e20-120d-4a69-a7c4-af8383183e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045172 Jul 29 13:05:37.247755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 501/1027] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:38.258855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:38.260995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:38.267629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:38.268083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:38.268849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:38.269319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:38.299696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-771b69d2-3f10-44c7-97b8-d5cce8f58730 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044779 Jul 29 13:05:38.300238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 527/1028] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:39.312705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:39.314909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:39.321789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:39.322255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:39.323031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:39.323475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:39.352747 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c4e95172-7293-4edd-8820-7a1557a91c59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044059 Jul 29 13:05:39.353286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 502/1029] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:40.364773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:40.366974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:40.373464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:40.373891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:40.374658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:40.375100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:40.403909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1519c53d-b77f-4635-b253-c5b470bbc0cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043112 Jul 29 13:05:40.404449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 528/1030] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:41.416927 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:41.419117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:41.420983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:41.426396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:41.426853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:41.427622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:41.428066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:41.431268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:41.460168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b390ae1d-bb83-4115-bea4-de34e4c7bea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047854 Jul 29 13:05:41.460743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 503/1031] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:42.472046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:42.474276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:42.476899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:42.482512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:42.482967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:42.483738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:42.484186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:42.487923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:05:42.514508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-abb69853-a340-4be1-b9be-6d467cd01aa3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046534 Jul 29 13:05:42.515054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 529/1032] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:43.527569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:43.529756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:43.536925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:43.537383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:43.538826 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:43.539270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:43.567910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-884f1e76-870d-43fc-947e-722783e2917c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044328 Jul 29 13:05:43.568461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 504/1033] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:44.580076 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:44.582253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:44.589460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:44.589934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:44.590697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:44.591130 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:44.619840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a08d9109-4899-4dc3-88fa-36c000c501c5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043798 Jul 29 13:05:44.620385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 530/1034] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:45.631442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:45.634221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:45.640660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:45.641116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:45.641914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:45.642357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:45.670783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a0361c23-a2db-4768-a30e-702e4b8011c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043273 Jul 29 13:05:45.671335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 505/1035] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:46.682947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:46.685013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:46.691645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:46.691986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:46.692750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:46.693186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:46.722958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cdcba4bc-0a70-4daf-b1b1-22d31dd5b1ec tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044053 Jul 29 13:05:46.723508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 531/1036] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:47.735286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:47.737397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:47.743898 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:47.744352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:47.745116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:47.745560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:47.774788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f714f0d1-2422-4c24-9b58-7ddb1472e041 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043534 Jul 29 13:05:47.775339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 506/1037] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:48.787033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:48.789172 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:48.795713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:48.796158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:48.796908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:48.797338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:48.826674 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b2a4f870-da37-484a-839a-7051fa559fa9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043609 Jul 29 13:05:48.827205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 532/1038] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:49.839131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:49.841320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:49.847859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:49.848314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:49.849101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:49.849541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:49.878151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7ff735bc-5ab1-417c-bd45-1f927c42899b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043691 Jul 29 13:05:49.878697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 507/1039] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:50.891170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:50.893357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:50.899881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:50.900429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:50.901096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:50.901531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:50.930973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c02df3bf-ff1c-4339-94d6-0438539ea9c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043697 Jul 29 13:05:50.931534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 533/1040] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:51.943244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:51.945833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:51.952300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:51.952747 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:51.953499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:51.953967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:51.983255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cfedbbee-dbff-4f44-be58-55a2d6b5eb16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044033 Jul 29 13:05:51.983795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 508/1041] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:52.996726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:52.998827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:53.005395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:53.005876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:53.007275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:53.007714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:53.036350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1c0c3a4b-0907-4fd3-b709-987a8d0ea76d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043780 Jul 29 13:05:53.036900 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 534/1042] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:54.048139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:54.050217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:54.057165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:54.057614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:54.058412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:54.058849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:54.088046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-12486bd7-f4e3-41b0-8f8e-3cd62d88538f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043970 Jul 29 13:05:54.088586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 509/1043] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:55.100287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:55.102498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:55.109225 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:55.109681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:55.110487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:55.110925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:55.141573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2aaecdc3-84c2-4108-b082-cfb0f6da9784 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045238 Jul 29 13:05:55.142285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 535/1044] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:56.154376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:56.156534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:56.163646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:56.164105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:56.164874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:56.165317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:56.200820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-76026d9e-d312-492e-8f3d-efd24b1e167d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050329 Jul 29 13:05:56.201395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 510/1045] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:57.214029 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:57.216236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:57.222729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:57.223180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:57.223954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:57.224396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:57.257408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0113121c-2cdf-432c-be30-121cf24514a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047497 Jul 29 13:05:57.257918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 536/1046] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:58.269051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:58.271238 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:58.278274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:58.278729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:58.279497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:58.279956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:58.309538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a3d74f51-35ee-4ba4-a4ea-ff3ea8c1ac00 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044435 Jul 29 13:05:58.310107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 511/1047] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:05:59.323423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:05:59.326482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:05:59.333969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:59.334425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:59.335861 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:05:59.336296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:05:59.365688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2368a112-6f5a-401d-be47-cf0aa79a2309 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047757 Jul 29 13:05:59.366265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 537/1048] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:05:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:00.377693 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:00.379826 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:00.386344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:00.386800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:00.387573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:00.388015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:00.417506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6632b407-1592-478f-b6b7-a4d867e2a414 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043894 Jul 29 13:06:00.418085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 512/1049] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:01.430503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:01.432660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:01.439217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:01.439674 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:01.440442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:01.440884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:01.471075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-85c6b1a7-86e1-4bf3-81f9-6a5e88e18da6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045218 Jul 29 13:06:01.471674 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 538/1050] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:02.483823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:02.486059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:02.493095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:02.493542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:02.494327 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:02.494776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:02.523181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-64e97ac9-a9ef-4713-b9f9-86a6bbddcc48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043551 Jul 29 13:06:02.523722 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 513/1051] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:06:03.535412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:03.537590 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:03.544743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:03.545198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:03.546003 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:03.546447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:03.575556 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c4283b11-b6f7-4b0f-bf99-285de288dab0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044020 Jul 29 13:06:03.576103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 539/1052] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:04.590592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:04.594483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:04.603704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:04.604167 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:04.605008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:04.605500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:04.650066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ef5520ae-1c4e-4741-8238-bc319f56b8ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066456 Jul 29 13:06:04.650647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 514/1053] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:05.663565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:05.665747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:05.673503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:05.674379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:05.675638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:05.676083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:05.707191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a6cf96da-d07a-4422-8bc8-7fb27eba25bd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048480 Jul 29 13:06:05.707746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 540/1054] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:06.720318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:06.722502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:06.734940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:06.735399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:06.736178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:06.736621 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:06.765255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1488fbce-4de8-4c11-bfe8-19957d8782b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049225 Jul 29 13:06:06.765813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 515/1055] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:07.777174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:07.779646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:07.786586 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:07.787040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:07.788314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:07.788750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:07.819254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-40edf8c3-087b-4b73-9c7c-a1a15ae7805f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046156 Jul 29 13:06:07.819916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 541/1056] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:08.831894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:08.834076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:08.840509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:08.840969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:08.841746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:08.842214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:08.872349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-078d7be9-6d83-4887-a783-2c54e43707ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044707 Jul 29 13:06:08.872904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 516/1057] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:09.884443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:09.886704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:09.893251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:09.893706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:09.894522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:09.894962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:09.925680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-df18f084-6790-428f-bc13-6fb80e7f4469 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045316 Jul 29 13:06:09.926286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 542/1058] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:10.938353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:10.940514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:10.947188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:10.947634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:10.948396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:10.948827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:10.978639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4e3d5adf-c099-46dc-a516-12fcd236a247 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044074 Jul 29 13:06:10.979225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 517/1059] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:11.991996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:11.994178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:12.000564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:12.001021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:12.001791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:12.002255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:12.032335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0dca6a23-07d7-4a76-9624-4f11842eacfc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044272 Jul 29 13:06:12.033091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 543/1060] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:13.044656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:13.046828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:13.049164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:13.054201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:13.054651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:13.055417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:13.055856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:13.058628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:13.086801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9a60d0ed-1db6-424b-9b1d-bfa3397447a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046105 Jul 29 13:06:13.087366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 518/1061] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:14.098916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:14.101092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:14.103563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:14.109176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:14.109633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:14.110438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:14.110882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:14.113505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:14.143200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2bd55f80-3b22-4c78-aad7-66e0af65eb0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048239 Jul 29 13:06:14.143748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 544/1062] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:15.155702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:15.158316 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:15.166484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:15.166945 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:15.167725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:15.168168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:15.199417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5dd32262-fed5-4922-a26f-83400b2bbe20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047816 Jul 29 13:06:15.200038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 519/1063] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:16.211868 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:16.214081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:16.220574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:16.221030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:16.221795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:16.222264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:16.252442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-860f053c-844b-4e8f-8fcc-0ed9b5b22bf9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045081 Jul 29 13:06:16.252988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 545/1064] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:17.264604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:17.266800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:17.273808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:17.274287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:17.275054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:17.275493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:17.304635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f4c54ed8-2a28-4152-8b7a-6a5c730cce0f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044030 Jul 29 13:06:17.305179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 520/1065] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:18.316652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:18.319669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:18.326132 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:18.326597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:18.327366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:18.327809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:18.358409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6fcdd1e8-5542-410f-8536-e09f5375dcbc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045708 Jul 29 13:06:18.358973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 546/1066] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:19.370863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:19.373086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:19.379547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:19.380001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:19.380765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:19.381207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:19.410367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-080e5c73-6f40-4a2c-973f-4076280b46b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043496 Jul 29 13:06:19.410910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 521/1067] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:20.423437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:20.425505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:20.432617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:20.433073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:20.433856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:20.434302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:20.462956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2608d81c-0dea-46cd-bb50-49fb2b5974c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043594 Jul 29 13:06:20.463507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 547/1068] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:21.479186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:21.481813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:21.488614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:21.489076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:21.489895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:21.490850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:21.525690 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bf24ab55-8b22-49a6-9a27-0b9ad5330a78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050205 Jul 29 13:06:21.526552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 522/1069] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:22.538155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:22.540210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:22.546744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:22.547197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:22.547960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:22.548401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:22.577924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e1ec9a7e-84f1-46d4-8df8-77018b4268c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044490 Jul 29 13:06:22.578486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 548/1070] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:23.590773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:23.592910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:23.599291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:23.599759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:23.600525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:23.600960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:23.629783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-50593a7f-004a-4934-96f8-bafbf9fb06df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042938 Jul 29 13:06:23.630368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 523/1071] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:24.642638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:24.644776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:24.651518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:24.651964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:24.652721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:24.653157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:24.681927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-13d1316d-17d9-48ba-b30d-9c83c21e36e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043201 Jul 29 13:06:24.682470 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 549/1072] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:25.693791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:25.696046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:25.702761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:25.703215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:25.703982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:25.704421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:25.733477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-54e6ed35-9362-452c-947f-d52d8827fd38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043772 Jul 29 13:06:25.734055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 524/1073] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:26.745610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:26.747771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:26.754302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:26.754744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:26.755497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:26.755929 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:26.785237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-11a67297-dd9e-42ce-9a2a-59f538fe848f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043652 Jul 29 13:06:26.785780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 550/1074] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:27.798216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:27.800342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:27.807321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:27.807783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:27.808554 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:27.808996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:27.838273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-80f95762-8a3d-4a9c-9af9-8b1dc2938fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044140 Jul 29 13:06:27.838821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 525/1075] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:28.850954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:28.853126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:28.859815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:28.860269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:28.861031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:28.861469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:28.890244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4a373e40-7ddb-4363-9a39-d6e385a20995 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043742 Jul 29 13:06:28.890790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 551/1076] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:29.902635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:29.904718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:29.911145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:29.911590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:29.912347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:29.912782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:29.941618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c968a452-64ab-4f39-82dc-e43445252fca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043040 Jul 29 13:06:29.942185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 526/1077] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:30.955115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:30.957253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:30.964446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:30.964893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:30.965744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:30.966156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:30.995777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d809b296-c22a-48e1-b5cc-93035f7e6f9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044610 Jul 29 13:06:30.996341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 552/1078] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:32.008141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:32.010352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:32.016864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:32.017321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:32.018126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:32.018572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:32.049210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e681d54d-0ab2-4cbd-a20c-99432ab8f602 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045039 Jul 29 13:06:32.049765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 527/1079] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:33.060820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:33.063039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:33.073650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:33.074128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:33.074915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:33.075360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:33.105117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d35a0bc3-8283-4353-85b2-42bc36797ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048310 Jul 29 13:06:33.105676 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 553/1080] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:34.118430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:34.120616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:34.127148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:34.127608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:34.128380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:34.128824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:34.158714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-31835922-adbc-47ed-8c6a-224e40d9b9b7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044918 Jul 29 13:06:34.159269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 528/1081] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:35.171698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:35.174064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:35.180783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:35.181385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:35.182299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:35.182827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:35.213856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d5a6604f-d98b-4300-a8cf-7b54ff6f1bc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046331 Jul 29 13:06:35.214427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 554/1082] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:36.226353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:36.228504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:36.235652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:36.236114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:36.236891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:36.237343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:36.266249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6c717e8f-f5b2-4b97-9503-609e6b11c0de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044023 Jul 29 13:06:36.266792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 529/1083] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:37.278971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:37.281149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:37.288495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:37.288938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:37.291105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:37.291105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:37.319714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-eac18f9d-17ca-475c-9ecb-433dd7ef9140 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044808 Jul 29 13:06:37.320276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 555/1084] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:38.331228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:38.333346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:38.339889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:38.340334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:38.341088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:38.341523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:38.371158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7e403a9d-e1ec-45d2-8289-7f7e656d39bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043917 Jul 29 13:06:38.371697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 530/1085] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:39.383113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:39.385217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:39.391692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:39.392138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:39.392930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:39.393366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:39.422205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1045c3f6-a7ae-45cd-bdfb-f161110bedd3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043079 Jul 29 13:06:39.422751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 556/1086] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:40.434637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:40.436724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:40.442958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:40.443415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:40.444183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:40.444628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:40.474045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-620c1dca-e8c3-430b-8725-8e0c3e8b6fe6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043504 Jul 29 13:06:40.475663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 531/1087] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:41.488206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:41.491126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:41.497161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:41.497615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:41.498424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:41.498870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:41.528828 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9a11e61a-7502-43c9-8c54-03b6934e36a7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045068 Jul 29 13:06:41.529409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 557/1088] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:42.541259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:42.543486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:42.550019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:42.550475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:42.551244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:42.551687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:42.583423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6bee7f44-9c56-4429-9a36-433620f3c2ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046080 Jul 29 13:06:42.583984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 532/1089] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:43.595307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:43.597440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:43.604415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:43.604867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:43.605631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:43.606094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:43.635820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9f2f7905-f8aa-4560-8bcb-dc148432bab9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044512 Jul 29 13:06:43.636354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 558/1090] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:44.648956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:44.651164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:44.653437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:44.658925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:44.659381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:44.660145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:44.660586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:44.664346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:44.690641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a2000d66-e2e1-4ebc-aed4-f914cd687337 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046312 Jul 29 13:06:44.691188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 533/1091] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:45.703871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:45.705968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:45.708344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:45.713726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:45.714205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:45.714996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:45.715436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:45.718134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:06:45.745894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1bcac50f-8655-4ea0-8199-b3a8b710c45c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046045 Jul 29 13:06:45.746448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 559/1092] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:46.758366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:46.760465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:46.767162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:46.767616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:46.768378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:46.768820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:46.798658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4bbd713e-2a93-4583-8bef-e0d803a6a918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044334 Jul 29 13:06:46.799209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 534/1093] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:47.811250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:47.813403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:47.819979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:47.820430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:47.821189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:47.821628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:47.851320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5c30d0d0-b944-420a-a6cb-65350816678f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044094 Jul 29 13:06:47.851870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 560/1094] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:48.863825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:48.866071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:48.872539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:48.872989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:48.873754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:48.874214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:48.904123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9e3f4dc6-fe4d-4544-9819-a68842a3f3a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044336 Jul 29 13:06:48.904686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 535/1095] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:50.016667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:50.018842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:50.024806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:50.025256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:50.026044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:50.026488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:50.055968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-50c28b3f-3eb5-4b73-a597-a05bbaf0b16b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.143402 Jul 29 13:06:50.056528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 561/1096] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:51.068986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:51.071173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:51.077638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:51.078129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:51.078901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:51.079336 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:51.108968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-25da4c8e-25b0-4c04-8474-c8b5617c0207 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044564 Jul 29 13:06:51.109528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 536/1097] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:52.122454 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:52.124302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:52.131324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:52.131777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:52.132545 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:52.132986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:52.164487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-707c256b-5ea1-4d1a-93e1-8aea07620809 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046463 Jul 29 13:06:52.165042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 562/1098] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:53.176794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:53.179007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:53.185901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:53.186363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:53.187134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:53.187580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:53.217955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f31435b1-e39c-4d44-9347-7ab41be27c1b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045047 Jul 29 13:06:53.218512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 537/1099] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:54.230770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:54.233367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:54.239880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:54.240332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:54.241153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:54.241533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:54.270891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f6b383b1-0734-405f-9813-8a3461d6b0c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044224 Jul 29 13:06:54.272079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 563/1100] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:55.284051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:55.286261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:55.293307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:55.293764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:55.294574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:55.295022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:55.324255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9dfb0ecc-7dce-41e6-9ff3-a5bcf15c2b70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044249 Jul 29 13:06:55.324765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 538/1101] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:56.337002 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:56.339162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:56.345624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:56.346104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:56.346857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:56.347287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:56.376005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e554b7eb-c6fd-4a72-9458-efdaea57039e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043478 Jul 29 13:06:56.376477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 564/1102] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:57.388641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:57.390794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:57.397301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:57.397760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:57.398556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:57.398998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:57.429360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-72d79a27-e6e8-4a32-a9b3-7d32064bc5a4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044704 Jul 29 13:06:57.429929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 539/1103] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:58.441592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:58.443722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:58.451209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:58.451965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:58.452748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:58.453185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:58.485222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a399d86d-97c3-48a9-9e22-82eeab23afe4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047613 Jul 29 13:06:58.485779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 565/1104] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:06:59.497109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:06:59.499325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:06:59.505908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:59.506366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:59.507152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:06:59.507595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:06:59.537608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-244310cb-f44e-49a2-a399-390cce5b592a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044385 Jul 29 13:06:59.538206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 540/1105] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:06:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:00.550344 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:00.553287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:00.559712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:00.560155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:00.560914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:00.561347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:00.590098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3aa7f12d-1e3f-4814-bbb0-9abbddd0437d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044310 Jul 29 13:07:00.590642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 566/1106] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:01.602012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:01.604145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:01.610855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:01.611304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:01.612062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:01.612502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:01.641477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5a0e8eb4-d5e0-468f-975e-d8cd128cb14b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043864 Jul 29 13:07:01.642057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 541/1107] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:02.653114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:02.655286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:02.663171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:02.663621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:02.664385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:02.664826 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:02.694769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-264e20e1-cd2c-46a0-9a6e-f839d7206629 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045616 Jul 29 13:07:02.695331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 567/1108] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:03.706956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:03.709092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:03.715541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:03.715994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:03.716752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:03.717189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:03.746677 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c0ff3443-783d-46e7-901b-3ff854f63697 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043628 Jul 29 13:07:03.747223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 542/1109] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:04.758833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:04.761025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:04.767498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:04.767961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:04.768870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:04.769317 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:04.799330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cac78d21-7613-4503-a865-df1269044c09 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044399 Jul 29 13:07:04.799881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 568/1110] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:05.813349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:05.818541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:05.829037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:05.829495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:05.830314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:05.830764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:05.866064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-959294c0-6fd2-424f-8faf-11e1b1f1191e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058486 Jul 29 13:07:05.866637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 543/1111] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:06.878168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:06.880337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:06.887014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:06.887466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:06.888231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:06.888669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:06.923326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-957a05b3-5780-4d8e-a465-1c01f6f45c52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045574 Jul 29 13:07:06.923326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 569/1112] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:07.932850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:07.935045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:07.941739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:07.942232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:07.943044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:07.943491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:07.974860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ff26a768-5351-4fa1-8880-0899b5a2540a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045414 Jul 29 13:07:07.975472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 544/1113] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:08.987557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:08.989688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:08.996721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:08.997173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:08.997980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:08.998424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:09.028543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-347db8ba-25c8-4955-8757-e229e3d7bce6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044980 Jul 29 13:07:09.029107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 570/1114] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:09.079399 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:07:09.079543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:07:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:07:10.040609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:10.042785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:10.049371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:10.049840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:10.050629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:10.051075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:10.080388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9e5999c8-e302-4f51-a831-156e8cd442d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043800 Jul 29 13:07:10.080956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 545/1115] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:11.092713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:11.094948 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:11.102250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:11.102744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:11.103512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:11.103955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:11.134377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b4ffaabe-bad4-4724-9b14-c44887aa77fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045576 Jul 29 13:07:11.134932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 571/1116] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:12.146990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:12.149149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:12.155391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:12.155839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:12.156605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:12.157051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:12.190538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8992eb6a-2667-42f4-8ceb-4be5f24582a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047564 Jul 29 13:07:12.191113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 546/1117] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:13.203181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:13.205376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:13.211944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:13.212402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:13.213171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:13.213613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:13.243638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8c81938f-987f-4435-81b3-c29b91217326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044594 Jul 29 13:07:13.244188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 572/1118] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:14.255951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:14.258113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:14.264536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:14.264990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:14.265756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:14.266225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:14.296227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a8cf941e-cf29-4643-9e83-d2db4bb6ff82 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044221 Jul 29 13:07:14.296795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 547/1119] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:15.309264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:15.311541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:15.318112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:15.318611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:15.319379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:15.319825 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:15.350100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7ea2bde6-fe1e-45d3-b0f9-6f26fbe18db2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044792 Jul 29 13:07:15.350646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 573/1120] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:16.362725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:16.364904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:16.367192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:16.372667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:16.373058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:16.373863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:16.374312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:16.377869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:16.403318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-574b93d7-6f33-4423-b8c7-d8a16bcc8768 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044608 Jul 29 13:07:16.403874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 548/1121] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:17.415699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:17.417747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:17.420110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:17.425542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:17.426047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:17.426837 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:17.427279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:17.429887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:17.457182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e4237cb8-0a75-4703-a9a0-acfff182d826 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045542 Jul 29 13:07:17.457715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 574/1122] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:18.470265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:18.472431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:18.479694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:18.480150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:18.480920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:18.481366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:18.510255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b4bda1b4-9ca0-4da6-9da1-cee12d6dd745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044064 Jul 29 13:07:18.510803 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 549/1123] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:07:19.522634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:19.524732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:19.531299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:19.531752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:19.532543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:19.532983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:19.562443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6068786f-3110-48ef-9f02-c12184e63727 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043814 Jul 29 13:07:19.563021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 575/1124] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:20.574932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:20.577090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:20.584255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:20.584711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:20.585482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:20.585963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:20.614596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b92cae3d-dc59-4261-9b6d-4e1bfa0afb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043639 Jul 29 13:07:20.615155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 550/1125] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:21.626996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:21.629119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:21.636171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:21.636616 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:21.637372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:21.637803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:21.668259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-581718fc-4581-4ded-88eb-1934dc8eccab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045260 Jul 29 13:07:21.668800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 576/1126] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:22.681187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:22.683424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:22.689969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:22.690425 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:22.691211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:22.691634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:22.720059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-874a0acb-2e80-4f95-ae79-c7612d38e0ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043503 Jul 29 13:07:22.720613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 551/1127] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:23.603123 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:07:23.603715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:07:23.733058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:23.735218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:23.741736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:23.742220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:23.742980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:23.743416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:23.772770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fd70a459-0033-4626-bbfa-9b0ff9f2907c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044077 Jul 29 13:07:23.773308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 577/1128] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:24.785027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:24.787831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:24.794370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:24.794830 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:24.795600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:24.796043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:24.825223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8d5759ff-a226-4463-b90c-f70d7474b7cd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044194 Jul 29 13:07:24.825770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 552/1129] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:25.838205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:25.840335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:25.846754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:25.847197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:25.847950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:25.848405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:25.881170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-36c7bc50-d921-482c-b700-7178dbb74bea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046967 Jul 29 13:07:25.881743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 578/1130] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:26.893356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:26.896118 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:26.902555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:26.903034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:26.903826 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:26.904269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:26.934277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-200ad2df-7fea-416c-9bec-25bf7cdef8db tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044811 Jul 29 13:07:26.934838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 553/1131] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:27.946970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:27.949156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:27.955740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:27.956197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:27.956967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:27.957413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:27.986539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5d9c42ee-916f-4bd2-bec0-52ea27d0a5a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043565 Jul 29 13:07:27.987088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 579/1132] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:28.999042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:29.001158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:29.008229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:29.008674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:29.009428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:29.009885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:29.038711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7058f686-8039-4e0d-9c01-03c09e0a47b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043704 Jul 29 13:07:29.039256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 554/1133] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:30.052865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:30.055446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:30.063358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:30.064054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:30.065206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:30.065893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:30.109828 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-03074ce3-f861-40ac-9c68-e0e911fb4968 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062236 Jul 29 13:07:30.110679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 580/1134] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:31.124699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:31.126885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:31.134593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:31.135331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:31.136580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:31.137307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:31.167644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ee9d8488-bd27-40c3-82d2-a68e3f92e16f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046949 Jul 29 13:07:31.168199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 555/1135] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:32.180949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:32.183213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:32.189867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:32.190410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:32.191230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:32.191726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:32.221109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b49c7dad-1ad5-4da6-b4c0-0f8bb6dfbaa0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044869 Jul 29 13:07:32.221935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 581/1136] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:33.234698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:33.236818 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:33.244024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:33.244468 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:33.245237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:33.245661 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:33.272084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:07:33.272281 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments (ip 10.222.0.66) !!! Jul 29 13:07:33.276697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0377f5fe-72e6-492e-a473-5710319fe42a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046095 Jul 29 13:07:33.281280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 556/1137] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:34.291185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:34.293523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:34.300170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:34.300618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:34.301384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:34.301880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:34.330562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a7ddb6e3-421c-4954-b424-3cded7b6a2b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043406 Jul 29 13:07:34.331108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 582/1138] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:35.343263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:35.345486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:35.352291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:35.352782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:35.353644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:35.354146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:35.385198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-149d0146-454f-46a3-a89d-38a1941668dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045856 Jul 29 13:07:35.385730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 557/1139] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:36.397440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:36.399613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:36.406109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:36.406565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:36.407334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:36.407758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:36.438864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fe353c92-12c2-43ef-8f72-624e9fdc3853 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045417 Jul 29 13:07:36.439433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 583/1140] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:37.451700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:37.454012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:37.461644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:37.462194 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:37.463095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:37.463603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:37.493723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7c4f510c-66bd-4ffd-917b-de5349c362b2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046337 Jul 29 13:07:37.494301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 558/1141] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:38.506320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:38.508490 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:38.515140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:38.515593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:38.516362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:38.516804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:38.550408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-850b878c-9354-44f5-8a47-eb5f5709139f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048184 Jul 29 13:07:38.550964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 584/1142] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:39.563536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:39.565671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:39.572838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:39.573295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:39.574085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:39.574528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:39.603633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8d430c5a-6ea6-4a45-ad91-51fad92fadde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044037 Jul 29 13:07:39.604206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 559/1143] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:40.617066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:40.619226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:40.625704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:40.626188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:40.626947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:40.627387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:40.656848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-27036d4c-2588-469e-8c96-4cc9c1c23eac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044436 Jul 29 13:07:40.657400 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 585/1144] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:41.670277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:41.672469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:41.679145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:41.679593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:41.680347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:41.680782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:41.709536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6044680d-c47f-4baf-901a-98b6fcdba60f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043414 Jul 29 13:07:41.710109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 560/1145] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:42.722146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:42.724339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:42.730546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:42.731001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:42.731762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:42.732206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:42.762461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5258b6c4-9f2b-4de1-8a7e-9d3de934a21d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044402 Jul 29 13:07:42.763014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 586/1146] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:43.775709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:43.777811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:43.784474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:43.784971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:43.785804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:43.786335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:43.815443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8019ca24-fa51-4aab-9fdd-25b9d5eb1c0d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044015 Jul 29 13:07:43.815997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 561/1147] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:44.827902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:44.830150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:44.836727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:44.837176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:44.837982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:44.838426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:44.868123 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-26643384-10ec-48dd-80b3-f721d3079d4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044297 Jul 29 13:07:44.868672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 587/1148] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:45.880865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:45.883026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:45.889456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:45.889941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:45.890697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:45.891132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:45.920301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1da5ede6-9d5d-4c98-8ea4-caff2a9f68dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043872 Jul 29 13:07:45.920862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 562/1149] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:46.933181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:46.935294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:46.941740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:46.942226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:46.942992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:46.943435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:46.972659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7caadf8f-deb2-4fd9-894a-8faa1adeb43a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043539 Jul 29 13:07:46.973863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 588/1150] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:47.985904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:47.987973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:47.990811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:47.996183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:47.996634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:47.997406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:47.997869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:48.000393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:48.028367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4782a085-5b1f-4554-8fc6-89e0ea4fd599 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046784 Jul 29 13:07:48.028931 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 563/1151] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:49.040773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:49.042889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:49.045350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:49.050754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:49.051208 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:49.051973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:49.052413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:49.054952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:07:49.083117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49a1573d-fb9f-4ffe-a040-a0497645a8f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045804 Jul 29 13:07:49.083667 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 589/1152] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:50.095344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:50.097530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:50.104957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:50.105415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:50.106213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:50.106660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:50.136758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-257d1e35-60d9-4f6b-a1ff-b93f23fc0114 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045326 Jul 29 13:07:50.137323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 564/1153] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:51.149036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:51.151209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:51.157746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:51.158237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:51.159002 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:51.159445 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:51.189738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-231e9d8b-4b84-4818-b95f-504dea087afe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044647 Jul 29 13:07:51.190315 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 590/1154] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:52.202761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:52.204853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:52.211366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:52.211819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:52.212588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:52.213028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:52.242290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5ac503cc-a35b-4da0-9920-49fe84191b83 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043574 Jul 29 13:07:52.242836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 565/1155] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:53.254412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:53.256558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:53.262954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:53.263398 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:53.264151 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:53.264582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:53.294599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-086036f5-d28a-4efe-8cfa-4a5dd64cb1e5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044018 Jul 29 13:07:53.295213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 591/1156] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:54.307776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:54.309957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:54.316774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:54.317236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:54.318055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:54.318502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:54.347541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bacdd204-8ad8-47d8-90c4-68c68e8be8cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043729 Jul 29 13:07:54.348624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 566/1157] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:55.360616 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:55.362790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:55.369256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:55.369712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:55.370518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:55.370961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:55.400161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e9e262eb-8a17-4256-8334-1dedadd27ce5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043634 Jul 29 13:07:55.400639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 592/1158] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:56.412312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:56.414566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:56.421225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:56.421681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:56.422484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:56.422924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:56.455318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-edbf12d4-18d0-4dea-9bce-e890eeb80654 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046911 Jul 29 13:07:56.455876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 567/1159] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:57.468364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:57.471008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:57.478301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:57.478752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:57.479521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:57.479951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:57.509743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-67cc9966-3746-4a06-ba9e-66cdd9ae8918 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045562 Jul 29 13:07:57.510333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 593/1160] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:07:58.521954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:58.524128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:58.530732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:58.531179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:58.531949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:58.532388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:58.562806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e5ca8f19-6849-44e3-ac9d-3322b06219ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044774 Jul 29 13:07:58.563371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 568/1161] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:07:59.575626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:07:59.577758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:07:59.585369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:59.585813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:59.586598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:07:59.587033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:07:59.617328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-809b30eb-42bd-46b2-b93b-136adb1ceb05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045533 Jul 29 13:07:59.618532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 594/1162] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:07:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:00.629964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:00.632109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:00.638758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:00.639214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:00.639981 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:00.640422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:00.671763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-93e75cc7-6c95-48fe-964e-f22e16b546d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045784 Jul 29 13:08:00.672337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 569/1163] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:01.684546 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:01.686696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:01.693093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:01.693538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:01.694321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:01.694755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:01.723567 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-df4d3c3e-c94e-4672-9a77-d908c7bc9937 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042442 Jul 29 13:08:01.724099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 595/1164] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:02.736435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:02.739226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:02.745688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:02.746173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:02.746973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:02.747415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:02.778104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-aafbca1c-330d-4fe1-91df-4c9d45cda4c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046019 Jul 29 13:08:02.778659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 570/1165] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:03.791374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:03.793562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:03.800040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:03.800492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:03.801273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:03.801712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:03.831875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2b1772c0-b2a0-44fb-bb44-67e8ccfe78e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044495 Jul 29 13:08:03.833049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 596/1166] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:04.844122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:04.846282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:04.853214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:04.853656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:04.854447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:04.854879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:04.884588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-385fd72a-30a5-4489-8290-aedb7aebb04d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044390 Jul 29 13:08:04.885138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 571/1167] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:05.896388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:05.898591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:05.905063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:05.905514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:05.906296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:05.906738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:05.935748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-58604ecb-8ccd-48c7-b62e-9d45cb4fa5ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043464 Jul 29 13:08:05.936292 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 597/1168] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:06.948511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:06.950685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:06.957168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:06.958183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:06.958957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:06.959399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:06.987984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1c063cba-7ded-4430-9180-52afde40fcf8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043473 Jul 29 13:08:06.988531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 572/1169] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:07.999981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:08.002177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:08.009269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:08.009720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:08.010512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:08.010954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:08.041041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d391fcdf-37ad-4afb-8094-b85c19da95c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044961 Jul 29 13:08:08.041589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 598/1170] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:09.053361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:09.055435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:09.061979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:09.062424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:09.063178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:09.063609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:09.092759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9dd86548-fedf-4e96-95e8-dc91a46a3704 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044052 Jul 29 13:08:09.093296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 573/1171] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:10.105093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:10.107298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:10.114426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:10.114884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:10.115659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:10.116189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:10.146705 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-38315233-be4b-477e-bdec-eab9045c6ff2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045566 Jul 29 13:08:10.147261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 599/1172] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:11.159064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:11.161809 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:11.168204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:11.168655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:11.169417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:11.169878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:11.198310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3693ec36-dabc-4a00-844a-a1c0c8ac504c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043181 Jul 29 13:08:11.198855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 574/1173] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:12.211745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:12.213996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:12.220186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:12.220631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:12.221391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:12.221906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:12.251511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b5122051-616b-4753-9bf0-6b498cee671f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043708 Jul 29 13:08:12.252052 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 600/1174] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:13.262946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:13.265086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:13.272055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:13.272511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:13.273274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:13.273715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:13.303087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-84eb0680-f755-446d-acb6-e13869ea41e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044101 Jul 29 13:08:13.303635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 575/1175] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:14.315687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:14.318540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:14.325027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:14.325482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:14.326280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:14.326723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:14.356268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fa565b43-f413-47e9-bf71-20056a94e34d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044563 Jul 29 13:08:14.356806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 601/1176] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:15.368820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:15.371051 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:15.377443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:15.377922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:15.379196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:15.379639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:15.408803 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-82e0617f-ae75-4475-bbb1-ea0139c992b8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043934 Jul 29 13:08:15.409353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 576/1177] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:16.421072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:16.423199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:16.431061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:16.431551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:16.432616 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:16.432747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:16.464444 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b7d487a-e7c3-41fa-ac4f-103f107c13f1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047383 Jul 29 13:08:16.464999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 602/1178] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:17.477293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:17.479437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:17.486186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:17.486641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:17.487417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:17.487859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:17.517245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f570b7c8-f4ba-411e-a0ba-b08510bad409 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044483 Jul 29 13:08:17.517856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 577/1179] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:18.529978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:18.532042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:18.541168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:18.541662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:18.542549 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:18.543036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:18.573862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0c7478cf-bb93-4f13-9e6f-aef919e5abb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047878 Jul 29 13:08:18.574455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 603/1180] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:19.586250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:19.588403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:19.590725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:19.595923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:19.596371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:19.597125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:19.597747 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:19.600342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:19.628032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b86ebbae-201a-4b6e-abbf-39986a04a921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046386 Jul 29 13:08:19.629103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 578/1181] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:20.640676 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:20.642883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:20.645942 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:20.651424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:20.651882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:20.652656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:20.653103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:20.655662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:20.685605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-71534e68-fe32-4519-b61f-5610feda2be2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048758 Jul 29 13:08:20.686691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 604/1182] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:21.698224 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:21.700351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:21.706898 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:21.707346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:21.708107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:21.708541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:21.737262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-edc903d8-e404-47d7-a047-e9acfc8cdfc9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043105 Jul 29 13:08:21.737802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 579/1183] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:22.750289 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:22.752480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:22.759041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:22.759495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:22.760260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:22.760703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:22.790105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4d1df1a3-3cbe-4862-a965-64bce77aafb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043850 Jul 29 13:08:22.790649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 605/1184] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:23.801595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:23.803763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:23.810320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:23.810773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:23.811537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:23.811996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:23.841180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-05edf703-1685-457c-8f2c-a6e55341f061 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043698 Jul 29 13:08:23.841720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 580/1185] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:24.853312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:24.855541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:24.862396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:24.862854 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:24.864263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:24.864713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:24.893643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b7a6e806-e30c-4780-b394-e77049227f2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044307 Jul 29 13:08:24.894824 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 606/1186] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:25.906656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:25.908829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:25.915344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:25.915796 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:25.916562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:25.917001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:25.947837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ec036118-45e7-485f-9daf-e6162e925f42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045173 Jul 29 13:08:25.948401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 581/1187] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:26.960514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:26.962762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:26.969211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:26.969666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:26.970466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:26.970937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:27.001270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2fde0062-fd96-4da3-b3b3-7e4921bd3282 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045250 Jul 29 13:08:27.001831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 607/1188] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:28.014444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:28.016761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:28.024801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:28.025284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:28.026329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:28.026853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:28.059271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b62c0b0a-75ce-457f-9e24-f1461482ca7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049682 Jul 29 13:08:28.060024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 582/1189] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:28.620402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:08:28.620553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:08:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:08:29.072353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:29.074561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:29.081025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:29.081483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:29.082632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:29.083466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:29.116508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e90f3a2d-6bb8-4214-bdeb-c7cd02c05326 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048149 Jul 29 13:08:29.117088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 608/1190] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:30.129018 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:30.131186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:30.137600 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:30.138090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:30.138853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:30.139288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:30.168705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cc383179-53ef-4d07-b5a0-ab70d7a30685 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043735 Jul 29 13:08:30.169244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 583/1191] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:31.182085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:31.184419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:31.191330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:31.191782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:31.192578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:31.193022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:31.227164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5fc7db83-80ee-4df4-9394-c9341cb015b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048872 Jul 29 13:08:31.228131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 609/1192] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:32.240193 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:32.242384 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:32.249033 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:32.249567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:32.250434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:32.250917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:32.280660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1ce9847a-5d4b-425a-9ebd-3fdc843a2909 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044443 Jul 29 13:08:32.281217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 584/1193] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:33.293937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:33.296169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:33.302779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:33.303235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:33.304284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:33.305137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:33.339684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b603b4eb-b76c-425c-915b-e4e7362a61ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049748 Jul 29 13:08:33.340232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 610/1194] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:34.352046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:34.354227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:34.361178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:34.361638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:34.362438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:34.363458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:34.395256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cfe40a76-15b4-4781-b220-7cc5d953cd5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047481 Jul 29 13:08:34.395827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 585/1195] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:35.410258 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:35.412527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:35.419155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:35.419613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:35.420379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:35.420828 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:35.450298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e8771bbf-3793-416b-937f-a827fb04e526 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044556 Jul 29 13:08:35.450841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 611/1196] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:36.462852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:36.464920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:36.471356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:36.471819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:36.472589 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:36.473033 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:36.502277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c0a277a5-3e7b-4120-bb68-744c4b7e8d22 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043420 Jul 29 13:08:36.502888 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 586/1197] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:37.515838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:37.517924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:37.524902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:37.525351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:37.526134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:37.526572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:37.556421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3a8316eb-8e93-4b87-951f-4b391ed4643f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044701 Jul 29 13:08:37.556959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 612/1198] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:38.569059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:38.571274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:38.577887 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:38.578338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:38.579099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:38.579531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:38.609731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a520b263-434b-4ad8-b52d-2421b9defa90 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045213 Jul 29 13:08:38.610333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 587/1199] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:39.627199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:39.629426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:39.636129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:39.636669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:39.637620 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:39.638177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:39.673044 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b2d4f224-65a2-4c95-9fe7-0c6b98089da8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054066 Jul 29 13:08:39.673921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 613/1200] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:40.686402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:40.689055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:40.695913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:40.696360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:40.697126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:40.697559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:40.726569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0ddcb6dc-41f9-4140-8d90-83a9f728d925 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044611 Jul 29 13:08:40.727123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 588/1201] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:41.740347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:41.742431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:41.748619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:41.749063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:41.749841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:41.750273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:41.780362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-42fc381b-63a9-4ff6-90ec-bea7423c7bc1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044712 Jul 29 13:08:41.780908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 614/1202] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:42.792687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:42.794879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:42.803780 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:42.804580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:42.805480 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:42.805964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:42.835769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d4823138-efd0-4047-8aa5-62ee6ef7eb2d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047061 Jul 29 13:08:42.836311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 589/1203] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:43.847282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:43.849403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:43.855893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:43.856345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:43.857112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:43.857552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:43.888196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-62180b5f-66ac-411c-8e21-0c8ec9543ca2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044976 Jul 29 13:08:43.888750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 615/1204] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:44.900563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:44.902694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:44.909132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:44.909617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:44.910412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:44.910854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:44.939864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d7984084-0a0e-4691-9ded-d223d251f1d3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043367 Jul 29 13:08:44.940402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 590/1205] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:45.952661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:45.955026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:45.962333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:45.962784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:45.963550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:45.963993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:45.993838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e8410b52-91a2-4c7a-a5f9-e3f37f7cbe8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045128 Jul 29 13:08:45.994336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 616/1206] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:47.006750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:47.008929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:47.015691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:47.016149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:47.016934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:47.017409 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:47.053478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b2780f4d-2d82-4e5a-81d9-b1e55d5f8e68 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051229 Jul 29 13:08:47.053970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 591/1207] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:48.066405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:48.068567 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:48.075094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:48.075541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:48.076330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:48.076767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:48.106109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-34fd981b-c7e5-450c-83c8-58acd1201eff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044297 Jul 29 13:08:48.106653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 617/1208] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:48.138458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:08:48.138611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:08:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:08:49.118860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:49.120985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:49.127440 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:49.127893 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:49.129158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:49.129598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:49.159593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b29e82b9-4ddd-4497-8293-96f7301d84a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044630 Jul 29 13:08:49.160137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 592/1209] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:50.171915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:50.174327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:50.180646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:50.181091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:50.181860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:50.182302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:50.211906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-59153b3a-e520-43db-852d-247a65f04f44 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043952 Jul 29 13:08:50.212450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 618/1210] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:51.224580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:51.226764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:51.229035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:51.234735 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:51.235191 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:51.235962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:51.236406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:51.240790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:51.266895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a2186f6d-3093-4131-ad1d-cea85425c12b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046837 Jul 29 13:08:51.267445 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 593/1211] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:51.495663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:08:51.495849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:08:52.279702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:52.281947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:52.284912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:52.290291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:52.290744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:52.291502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:52.291937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:52.294434 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:08:52.321983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1f9d087d-e1f4-4c58-9f4c-8483dd10f216 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046232 Jul 29 13:08:52.322523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 619/1212] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:53.334917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:53.337078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:53.344417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:53.344896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:53.346104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:53.346593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:53.383839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a927c627-be4c-4d9a-a814-6b50f259b220 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053377 Jul 29 13:08:53.384339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 594/1213] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:54.396652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:54.399039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:54.406526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:54.407213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:54.408064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:54.408609 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:54.441942 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-563b8de4-8536-4b7e-9414-17e8a2dd8c50 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050056 Jul 29 13:08:54.442621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 620/1214] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:55.454888 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:55.457500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:55.464091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:55.464561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:55.465309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:55.465752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:55.494994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7db2401b-72ae-402d-ae97-c5d082387579 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044195 Jul 29 13:08:55.495543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 595/1215] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:56.507290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:56.509435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:56.515917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:56.516363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:56.517120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:56.517552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:56.547326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e3ebf793-7ffe-4a91-9fd5-9a8d6d9f9c93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044571 Jul 29 13:08:56.547865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 621/1216] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:57.560554 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:57.562733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:57.569974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:57.570425 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:57.571513 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:57.571713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:57.600208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f6182e32-cf55-4afc-a89d-919535b44430 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043565 Jul 29 13:08:57.600944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 596/1217] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:58.612868 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:58.615047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:58.621480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:58.622031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:58.622796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:58.623232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:58.651839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4fb97ee8-d625-48f4-a3fd-9a2a262479ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043824 Jul 29 13:08:58.652372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 622/1218] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:08:59.663743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:08:59.665903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:08:59.672732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:59.673252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:59.674119 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:08:59.674573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:08:59.704847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b46a4173-fb01-4188-bb33-89c925e7f82e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045571 Jul 29 13:08:59.705395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 597/1219] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:08:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:00.718164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:00.720270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:00.726200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:00.726646 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:00.727406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:00.727837 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:00.757048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e50edb9b-aeae-44ca-ae02-8336ee58ca3e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043332 Jul 29 13:09:00.757582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 623/1220] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:01.769505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:01.771699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:01.778179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:01.778636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:01.779433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:01.779896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:01.808199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cdd3babc-59b6-4380-a13c-7d688bc9b61d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043384 Jul 29 13:09:01.808735 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 598/1221] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:02.820085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:02.822262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:02.828915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:02.830057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:02.830310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:02.830581 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:02.862502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-102a547e-548f-4f62-9fae-337fdda028d2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046282 Jul 29 13:09:02.863028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 624/1222] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:03.874955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:03.877105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:03.884315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:03.884757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:03.885529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:03.886003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:03.915587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0ec27e5c-42e4-43b5-acf8-0b07aa8d4cdb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044598 Jul 29 13:09:03.916151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 599/1223] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:04.928155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:04.930325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:04.936745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:04.937195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:04.937980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:04.938419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:04.967589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ad70aa7a-452b-4b8a-bd9f-b28302e3a8ce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044015 Jul 29 13:09:04.968126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 625/1224] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:05.979924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:05.982123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:05.989366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:05.989828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:05.990602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:05.991040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:06.020058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fe97c9b0-ed6d-4789-98c1-de414002afbe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044158 Jul 29 13:09:06.020603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 600/1225] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:07.032926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:07.035276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:07.042280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:07.042759 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:07.043551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:07.043993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:07.073734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-69243b2e-9f6b-4423-963f-8907d1b88e0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044977 Jul 29 13:09:07.074326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 626/1226] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:08.086561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:08.088700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:08.095196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:08.095652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:08.097053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:08.097500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:08.126962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-659e414c-c559-4a9a-be3f-f0f9c97717fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044337 Jul 29 13:09:08.127530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 601/1227] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:09.139673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:09.141836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:09.148339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:09.148794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:09.149560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:09.150051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:09.179833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2b609788-3c05-47cf-acc4-f437cee6dc3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044266 Jul 29 13:09:09.180387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 627/1228] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:10.192711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:10.194901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:10.201364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:10.201838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:10.202611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:10.203049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:10.232574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14244994-9cf3-4aea-951e-cb49dd33397e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044552 Jul 29 13:09:10.233121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 602/1229] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:11.244962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:11.247169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:11.253670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:11.254146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:11.254913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:11.255348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:11.285051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c8a33df9-6edc-40fd-88d1-389e07eac2d4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044057 Jul 29 13:09:11.285583 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 628/1230] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:12.297763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:12.300597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:12.306899 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:12.307358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:12.308128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:12.308569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:12.339173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-20bdfc69-ec76-43a6-a45e-616deed5f258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045483 Jul 29 13:09:12.339737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 603/1231] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:13.352285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:13.354469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:13.360970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:13.361410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:13.362186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:13.362617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:13.390739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-917544e9-f12f-4471-af4f-cf1fee395a7e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042371 Jul 29 13:09:13.391214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 629/1232] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:14.403430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:14.405602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:14.412252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:14.412708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:14.413496 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:14.413993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:14.443862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3dd9f2d5-3f66-4e35-9370-93797a93877e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044669 Jul 29 13:09:14.444418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 604/1233] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:15.455670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:15.457765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:15.464310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:15.464795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:15.465589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:15.466064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:15.496287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-23f0e394-0e60-44a1-a626-73a889f2501f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044831 Jul 29 13:09:15.496854 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 630/1234] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:16.507988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:16.510200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:16.516580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:16.517031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:16.517788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:16.518754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:16.547602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-92038873-3f1f-4c43-8d51-ac6f083873c4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043612 Jul 29 13:09:16.548142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 605/1235] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:17.559975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:17.562146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:17.569137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:17.569599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:17.570391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:17.570834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:17.600952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7c379679-b671-4978-a487-7a41c5838c5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044972 Jul 29 13:09:17.601524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 631/1236] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:18.613611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:18.615792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:18.622306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:18.622796 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:18.623632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:18.624112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:18.654384 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a5cdc216-1c50-44f4-9d15-313aec34925c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045516 Jul 29 13:09:18.654964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 606/1237] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:19.667216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:19.669333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:19.676358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:19.676802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:19.677586 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:19.678055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:19.708218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ba3635c2-0128-4e01-9596-1b43fa2b8260 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044827 Jul 29 13:09:19.708772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 632/1238] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:20.720619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:20.723460 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:20.729804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:20.730286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:20.731036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:20.731468 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:20.760036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a9a113e7-91c5-4e91-9186-82991f6b8075 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043409 Jul 29 13:09:20.760570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 607/1239] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:21.772803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:21.775021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:21.781517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:21.782008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:21.782774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:21.783218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:21.812622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-597a3484-635d-4e20-973e-0d50ed062dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043769 Jul 29 13:09:21.813170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 633/1240] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:22.824628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:22.826865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:22.829149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:22.834434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:22.834898 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:22.835675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:22.836109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:22.838663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:22.866745 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-892fb52c-fe7d-404f-9990-428c99f54c07 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046103 Jul 29 13:09:22.867284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 608/1241] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:23.879613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:23.881803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:23.884233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:23.889424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:23.889913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:23.890682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:23.891122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:23.894901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:23.930551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-29e898dc-b433-453e-b0a9-71c485a7f184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055369 Jul 29 13:09:23.931119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 634/1242] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:09:24.943388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:24.945584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:24.952164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:24.952612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:24.953364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:24.953799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:24.982649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0af0ff2b-ed83-4a38-a541-4e304ed46d10 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043690 Jul 29 13:09:24.983193 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 609/1243] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:25.995605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:25.997729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:26.004857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:26.005310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:26.006093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:26.006533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:26.034916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a9161692-d2d3-4d76-b0bf-3b079e9d7f8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043346 Jul 29 13:09:26.035458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 635/1244] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:27.047616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:27.050231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:27.056696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:27.057151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:27.057949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:27.058397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:27.087567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2dd7ce47-a398-4053-9135-429b7c964016 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044038 Jul 29 13:09:27.088114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 610/1245] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:28.100320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:28.102491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:28.108963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:28.110715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:28.111561 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:28.112239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:28.142739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e4669d89-c8e2-4760-b942-c0b5ef966cb8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046673 Jul 29 13:09:28.143924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 636/1246] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:29.155674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:29.157795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:29.164186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:29.164632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:29.165420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:29.165877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:29.195266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8a03b775-d377-4ea0-9352-2bbd6b946886 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043576 Jul 29 13:09:29.195806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 611/1247] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:30.207852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:30.210072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:30.216681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:30.217132 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:30.217922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:30.218365 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:30.248513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8eb9db6e-b109-4771-b4f9-5fe48d771aed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044913 Jul 29 13:09:30.249073 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 637/1248] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:31.260802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:31.263014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:31.270072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:31.270533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:31.271305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:31.271749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:31.301266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2d494f56-a311-4624-bd80-9385635c2b79 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044407 Jul 29 13:09:31.301844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 612/1249] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:32.313762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:32.316601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:32.323162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:32.323612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:32.324379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:32.324816 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:32.353666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3e7d7338-6c13-4378-9cba-b9baa5e7f0ea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043870 Jul 29 13:09:32.354243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 638/1250] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:33.368056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:33.371398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:33.379200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:33.379864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:33.381144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:33.381992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:33.415940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-59aa9fa9-1757-4077-b614-85132b074849 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053781 Jul 29 13:09:33.416489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 613/1251] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:34.429051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:34.431217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:34.437638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:34.438118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:34.438869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:34.439308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:34.468408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c516bba4-20fe-4132-8645-1d26940ea94f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043298 Jul 29 13:09:34.468947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 639/1252] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:09:35.480827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:35.482939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:35.489970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:35.490432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:35.491200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:35.491642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:35.521340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-be2e7eb5-fa2c-4f97-898f-16d7c13eadb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044601 Jul 29 13:09:35.521911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 614/1253] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:36.534096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:36.536267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:36.542703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:36.543156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:36.543916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:36.544348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:36.573133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-413bb589-20cd-431a-bb4d-c2b347386c8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043562 Jul 29 13:09:36.573697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 640/1254] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:37.584536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:37.586815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:37.593233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:37.593686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:37.594490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:37.594930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:37.625568 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2b417895-8130-4775-a996-7062e04b4455 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044896 Jul 29 13:09:37.626100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 615/1255] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:38.638103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:38.640191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:38.647437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:38.647899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:38.648666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:38.649106 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:38.678432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-52870c24-0806-484b-badb-90a35ca09d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044425 Jul 29 13:09:38.678984 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 641/1256] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:09:39.695652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:39.698209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:39.704976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:39.705422 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:39.706222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:39.706654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:39.734975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ae97b1e2-19d4-41a8-abad-e49519c4c9a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047707 Jul 29 13:09:39.735526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 616/1257] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:40.747885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:40.750078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:40.756559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:40.757012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:40.757779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:40.758246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:40.787552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-eef78933-9ac0-4928-89a1-83b217dab1a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043699 Jul 29 13:09:40.788097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 642/1258] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:41.800110 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:41.802258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:41.808401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:41.808845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:41.809596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:41.810065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:41.838700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e20b0544-81c3-4c93-81fb-5b8e291ed41d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042519 Jul 29 13:09:41.839235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 617/1259] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:42.851720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:42.853775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:42.860062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:42.860537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:42.861925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:42.862367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:42.891833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-365faebe-1539-446b-acfe-41778ed652f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044238 Jul 29 13:09:42.892389 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 643/1260] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:43.904086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:43.906290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:43.912734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:43.913192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:43.913996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:43.914475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:43.945561 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d615d242-561b-4144-a7e1-5cb5c0739f53 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045359 Jul 29 13:09:43.946136 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 618/1261] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:09:44.958192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:44.960303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:44.966781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:44.967225 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:44.967975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:44.968406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:44.997308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ae31609f-a38a-418c-8ac8-cc9104009f54 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043283 Jul 29 13:09:44.997869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 644/1262] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:46.010619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:46.012883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:46.020108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:46.020567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:46.021332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:46.022576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:46.052366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4d0acb67-111c-4d1b-8373-e79fd2cf5f20 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045980 Jul 29 13:09:46.052919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 619/1263] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:47.065180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:47.067480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:47.073883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:47.074342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:47.075115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:47.075558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:47.105424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9a13142c-5aa7-4a08-aeb9-f1c99deb9d05 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044814 Jul 29 13:09:47.106285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 645/1264] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:48.118464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:48.120594 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:48.127222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:48.127680 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:48.128452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:48.128978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:48.158875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7a3d50be-f249-4dbf-a777-c1d3c34e7374 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044037 Jul 29 13:09:48.159602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 620/1265] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:49.172529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:49.175204 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:49.181743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:49.182229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:49.182996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:49.183441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:49.213407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5fe653d1-d9e3-4d5e-b55c-592584c3a180 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044746 Jul 29 13:09:49.214022 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 646/1266] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:50.097081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:50.097803 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:50.106237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.106759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.107766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.108401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.138694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 13:09:50.178656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-ff4a344d-07e1-4849-a96b-b656dc9033ce req-797d9b7f-0791-4e19-bf91-88bfe02cdc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b362a80f-715f-4c80-8dae-26d950ffc42a", "tag": "6fe329f5-796e-43de-8e36-ae61133c8878"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:09:50.189250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-ff4a344d-07e1-4849-a96b-b656dc9033ce req-797d9b7f-0791-4e19-bf91-88bfe02cdc0f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.190006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-ff4a344d-07e1-4849-a96b-b656dc9033ce req-797d9b7f-0791-4e19-bf91-88bfe02cdc0f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.201953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-ff4a344d-07e1-4849-a96b-b656dc9033ce req-797d9b7f-0791-4e19-bf91-88bfe02cdc0f service nova] Creating event network-changed:6fe329f5-796e-43de-8e36-ae61133c8878 for instance b362a80f-715f-4c80-8dae-26d950ffc42a on hv-cinder-81914 Jul 29 13:09:50.210658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-ff4a344d-07e1-4849-a96b-b656dc9033ce req-797d9b7f-0791-4e19-bf91-88bfe02cdc0f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114774 Jul 29 13:09:50.221746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 647/1267] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:50.231318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5f07bd75-0739-4dcb-af30-e7f03231621a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 204 len: 0 microversion: 2.1 time: 0.138468 Jul 29 13:09:50.231625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:50.232008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 621/1268] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:09:50 2022] DELETE /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 13:09:50.238141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:50.241802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:50.242258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:50.245663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.246350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.247337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.250133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.250571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.250711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.251347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:50.251933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:50.294688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a10cd9a2-d37d-468c-ac5a-27880251d332 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071280 Jul 29 13:09:50.295274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 648/1269] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:50.531807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:50.540265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-394eae1b-6be8-4731-a38f-9afad86defff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1574 microversion: 2.1 time: 0.303020 Jul 29 13:09:50.540928 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 622/1270] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1574 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:09:51.307782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:51.310084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:51.317211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:51.317662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:51.318483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:51.318921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:51.351831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-73b175ad-c2f2-4460-8a90-c3a58ce6615e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048196 Jul 29 13:09:51.352392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 649/1271] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:51.507172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-27caacbd-1b51-4f69-b214-0edd8b8803aa req-17b28b5e-3722-44c4-bb10-0aa870a12db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362a80f-715f-4c80-8dae-26d950ffc42a", "name": "network-vif-deleted", "tag": "6fe329f5-796e-43de-8e36-ae61133c8878"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:09:51.516518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-27caacbd-1b51-4f69-b214-0edd8b8803aa req-17b28b5e-3722-44c4-bb10-0aa870a12db2 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:51.516964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-27caacbd-1b51-4f69-b214-0edd8b8803aa req-17b28b5e-3722-44c4-bb10-0aa870a12db2 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:51.520972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:51.529077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-27caacbd-1b51-4f69-b214-0edd8b8803aa req-17b28b5e-3722-44c4-bb10-0aa870a12db2 service nova] Creating event network-vif-deleted:6fe329f5-796e-43de-8e36-ae61133c8878 for instance b362a80f-715f-4c80-8dae-26d950ffc42a on hv-cinder-81914 Jul 29 13:09:51.534840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-27caacbd-1b51-4f69-b214-0edd8b8803aa req-17b28b5e-3722-44c4-bb10-0aa870a12db2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095030 Jul 29 13:09:51.535406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 623/1272] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:51.562358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:51.562918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:51.569495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:51.569978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:51.570736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:51.571171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:51.684792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:51.692575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ece41d81-d9f5-406c-a9ee-388c7e32ab44 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.134192 Jul 29 13:09:51.693145 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 650/1273] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:09:52.364510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:52.366796 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:52.374612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:52.375039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:52.375811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:52.376255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:52.412626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-eb2197a2-c027-442c-8cb6-952df47478c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052747 Jul 29 13:09:52.413200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 624/1274] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:52.713973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:52.714538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:52.721618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:52.722093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:52.722862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:52.723345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:52.739269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:52.786570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:52.794411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-63ade3f0-ee03-43d7-be75-6f5d21d70333 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084465 Jul 29 13:09:52.794974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 651/1275] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:52 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:53.424671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:53.426865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:53.429240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:53.434726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:53.435180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:53.435944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:53.436380 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:53.466394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-353782a8-c3a6-4f58-94af-a2391ecb6d63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045775 Jul 29 13:09:53.466934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 625/1276] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:53.815038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:53.815656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:53.822859 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:53.823311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:53.824071 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:53.824503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:53.884486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:53.891802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-109e00cb-f70a-4bbc-9f0c-9288d72cae0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080702 Jul 29 13:09:53.892387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 652/1277] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:53 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:54.478682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:54.480765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:54.488374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:54.488846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:54.489639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:54.490111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:54.520397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4c7319ff-67f9-4f06-a885-900669ac74a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045780 Jul 29 13:09:54.520942 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 626/1278] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:54.912193 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:54.912805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:54.915103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=38 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:09:54.920501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:54.920954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:54.921715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:54.922177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:54.987047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:54.994781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-13e31cb0-aba5-445e-93fd-3b354d9ace5d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086465 Jul 29 13:09:54.995353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 653/1279] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:54 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:55.532035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:55.534105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:55.540634 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:55.541097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:55.541890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:55.542335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:55.572204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a8e1c731-8dfa-490f-93fd-7e2e77e95683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044260 Jul 29 13:09:55.572759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 627/1280] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:56.014958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:56.015538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:56.022071 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:56.022519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:56.023271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:56.023706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:56.083363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:56.090926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5c13c3ef-bd96-41ae-8223-a6f56bbad66d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079761 Jul 29 13:09:56.091500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 654/1281] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:56.584388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:56.586652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:56.593202 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:56.593664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:56.594464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:56.594911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:56.625111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-12866f4d-d983-4904-a041-bbcdba5222b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044739 Jul 29 13:09:56.625749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 628/1282] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:57.113112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:57.114075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:57.123982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:57.124637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:57.125776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:57.126451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:57.194324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:57.201625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bb01cc8c-9976-4a9d-ba90-2490a701933c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.093736 Jul 29 13:09:57.202207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 655/1283] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:57.637537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:57.639649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:57.646573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:57.647024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:57.647819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:57.648276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:57.677433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a7ad7a2a-8abf-4782-b2cd-fa7cd7a75add tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044039 Jul 29 13:09:57.678002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 629/1284] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:58.223026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:58.223634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:58.230097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:58.230547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:58.231329 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:58.231766 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:58.292271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:58.299666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9478eea2-06a0-4647-92ab-c7a515c18492 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081196 Jul 29 13:09:58.300217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 656/1285] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:58 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:58.689806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:58.692109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:58.698649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:58.699128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:58.699897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:58.700339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:58.729995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1d8a6c4e-b989-470c-af5d-3f69b5717f61 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044136 Jul 29 13:09:58.730636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 630/1286] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:09:59.320838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:59.321450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:59.327978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:59.328427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:59.329206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:59.329648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:59.392699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:09:59.400179 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ad00bdb0-9d9d-493b-8fe5-d088d0d50a04 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083239 Jul 29 13:09:59.400752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 657/1287] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:09:59 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:09:59.742841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:09:59.744969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:09:59.752069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:59.752529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:59.753293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:09:59.753761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:09:59.782032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d7364bc0-bf87-4c49-b4f2-3a3eb5463aea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043090 Jul 29 13:09:59.782604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 631/1288] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:09:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:00.420637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:00.421207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:00.428376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:00.428827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:00.429591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:00.430059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:00.490614 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:00.498074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-38622084-1b26-4d42-9c83-ae0d40c9c873 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081418 Jul 29 13:10:00.498633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 658/1289] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:00.793916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:00.796063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:00.802992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:00.803441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:00.804201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:00.804665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:00.834335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a886d5d9-046c-48ba-995c-b323be1d3081 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044484 Jul 29 13:10:00.834877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 632/1290] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:01.519175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:01.519789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:01.526325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:01.526777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:01.527537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:01.527977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:01.590677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:01.598136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-493f9c89-ead4-4316-a59d-89f85d73d41e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083361 Jul 29 13:10:01.598696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 659/1291] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:01 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:01.846615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:01.848797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:01.855265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:01.855724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:01.856491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:01.856935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:01.886203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-69baaa46-a532-4fec-81d0-b79167d9d41c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043585 Jul 29 13:10:01.886757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 633/1292] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:02.618897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:02.619503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:02.625982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:02.626463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:02.627214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:02.627647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:02.688095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:02.695743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e0f7b9f8-74d6-4e75-8dff-6214b517f7e7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080683 Jul 29 13:10:02.696305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 660/1293] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:02.898532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:02.900658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:02.907169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:02.907624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:02.908400 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:02.908845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:02.938054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4b127da3-03cd-4555-ac5f-8addffad35d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043573 Jul 29 13:10:02.938645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 634/1294] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:03.716630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:03.717228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:03.724411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:03.724862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:03.725622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:03.726087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:03.790332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:03.797882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49e11260-8ade-4df9-a5f1-325f718f0de2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085128 Jul 29 13:10:03.798461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 661/1295] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:03 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:03.951601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:03.953741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:03.961012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:03.961471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:03.962268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:03.962714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:03.991844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-772f9975-3f55-449c-8654-2105890bb1fa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044165 Jul 29 13:10:03.992334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 635/1296] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:04.818536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:04.819134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:04.825683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:04.826167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:04.826928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:04.827362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:04.888346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:04.896079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-953da79e-101a-447d-ab97-502a29eab8cb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081432 Jul 29 13:10:04.896650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 662/1297] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:04 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:05.004067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:05.006221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:05.012623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:05.013073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:05.013845 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:05.014282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:05.043373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9418f26e-36b7-4fac-a154-a5489558b831 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043872 Jul 29 13:10:05.043925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 636/1298] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:10:05.916843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:05.917442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:05.924932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:05.925488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:05.926385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:05.926918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:05.986931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:05.994289 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ba617c1b-5572-4fc0-b450-55c7e9a285f9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081296 Jul 29 13:10:05.994851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 663/1299] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:05 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:06.056142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:06.058516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:06.066292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:06.066797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:06.067659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:06.068139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:06.099949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-59e9ed45-22c0-43e8-b97a-41da587c00ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048168 Jul 29 13:10:06.100552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 637/1300] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:07.015458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:07.016076 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:07.023259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:07.023716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:07.024483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:07.024917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:07.085209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:07.092633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d7b45e48-4c41-4817-baba-a0895de3787b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081016 Jul 29 13:10:07.093199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 664/1301] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:07.112827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:07.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:07.121656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:07.122152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:07.122902 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:07.123345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:07.153528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c4c57d9e-eeb4-4c06-8a67-f58a8c9a0135 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044992 Jul 29 13:10:07.154111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 638/1302] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:08.114684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:08.115347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:08.122018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:08.122505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:08.123252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:08.123695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:08.165766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:08.167939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:08.174954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:08.175416 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:08.176193 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:08.176642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:08.192922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:08.207049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e0d99cc6-c589-4f44-8e6b-2fe9777168bc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.097035 Jul 29 13:10:08.207652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 665/1303] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:08 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:08.209111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-590b078d-2e6d-4c05-8e86-1118cc9664a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047214 Jul 29 13:10:08.209684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 639/1304] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:10:09.221775 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:09.223926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:09.230505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:09.230954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:09.231712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:09.232146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:09.234175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:09.235068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:09.242098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:09.242552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:09.243317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:09.243759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:09.258542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:09.262230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2b78a584-ac16-400c-8b7c-22c2e011ae18 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044819 Jul 29 13:10:09.262794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 666/1305] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:09.307284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:09.315112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c6a4bc80-9221-45d6-92c7-f0d4dfae909e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084676 Jul 29 13:10:09.315699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 640/1306] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:09 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:10:10.277469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:10.280635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:10.290640 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:10.291313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:10.292464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:10.293130 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:10.332198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-de2ef49e-35bf-4652-88b8-ff834d69af9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061001 Jul 29 13:10:10.332747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 667/1307] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:10.336743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:10.337393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:10.343495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:10.343952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:10.344720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:10.345810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:10.408433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:10.416073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-39dd7dcb-51c2-4c7d-8c0e-0ce9c8b4ea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083525 Jul 29 13:10:10.416690 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 641/1308] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:10 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:10:11.344378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:11.346584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:11.353066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:11.353515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:11.354302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:11.354740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:11.357227 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:11.385415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ee2d700d-19f1-4064-9ea3-e6c7109c3b40 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044901 Jul 29 13:10:11.385927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 668/1309] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:11.436722 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:11.437340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:11.444426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:11.444883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:11.445653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:11.446154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:11.507151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:11.514688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6b14de99-b48f-48e3-8948-d02a2ff21b6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082065 Jul 29 13:10:11.515304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 642/1310] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:11 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:12.398669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:12.400884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:12.407550 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:12.408037 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:12.408811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:12.409257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:12.439497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2c6b5f6a-c0de-4615-bd51-1fc059989845 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044217 Jul 29 13:10:12.440045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 669/1311] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:12.536179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:12.536818 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:12.543455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:12.543908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:12.544671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:12.545108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:12.607992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:12.616670 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a3f6bb8d-63fe-4b51-bd55-61ce1072c387 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084342 Jul 29 13:10:12.617236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 643/1312] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:12 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:13.451863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:13.453945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:13.461174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:13.461630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:13.462428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:13.462873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:13.492384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7db28853-728f-4341-9b77-f7a4e8f3b908 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044611 Jul 29 13:10:13.492936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 670/1313] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:13.638087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:13.638699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:13.646610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:13.646610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:13.646610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:13.647426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:13.713236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:13.721455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2522a313-f2f8-4337-869b-11f8942e033d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087331 Jul 29 13:10:13.722101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 644/1314] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:13 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:14.504840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:14.507039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:14.513447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:14.513936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:14.514700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:14.515159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:14.544196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-445b513f-a2e3-4b36-ae2a-0a7eac451ff7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043534 Jul 29 13:10:14.544744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 671/1315] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:14.741612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:14.742174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:14.748568 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:14.749014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:14.749761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:14.750221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:14.809763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:14.817983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-57120e36-4941-46a6-8db3-b5398b148ab0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080239 Jul 29 13:10:14.818546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 645/1316] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:14 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:15.556958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:15.559447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:15.565933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:15.566407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:15.567156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:15.567589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:15.597089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0df7151d-e66a-40ae-8252-f373cbd28eef tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044053 Jul 29 13:10:15.597617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 672/1317] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:15.838884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:15.839414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:15.845831 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:15.846288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:15.847042 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:15.847475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:15.907871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:15.915244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8669eedc-229c-4af4-a97d-d0ac16fd500f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080268 Jul 29 13:10:15.915803 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 646/1318] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:15 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:16.609247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:16.612280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:16.618905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:16.619359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:16.620119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:16.620559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:16.649766 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-af969e30-c200-423c-a645-6211b7b41a0a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044496 Jul 29 13:10:16.650341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 673/1319] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:16.935213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:16.935827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:16.942957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:16.943449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:16.944215 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:16.944654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:17.008748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:17.016339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2f118de8-6d97-4577-89b8-017205506266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084988 Jul 29 13:10:17.016943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 647/1320] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:16 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:17.662581 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:17.664763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:17.671170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:17.671615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:17.672364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:17.672795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:17.702132 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8fb1307c-9ba9-4640-9fe6-dcc4fb04d948 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043407 Jul 29 13:10:17.702692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 674/1321] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:18.036651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:18.037196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:18.044582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:18.045034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:18.045793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:18.046261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:18.107066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:18.115640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-682dae88-5ae9-4a39-a6cb-dbb1918883a0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082860 Jul 29 13:10:18.116213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 648/1322] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:18 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:18.715199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:18.717471 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:18.724973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:18.725428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:18.726228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:18.726670 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:18.757176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f92bef0b-a597-4c86-8bc6-7f163afcbb6f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045975 Jul 29 13:10:18.757793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 675/1323] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:10:19.136507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:19.137126 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:19.144334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:19.144794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:19.145562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:19.146040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:19.206366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:19.213761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-55fb9d36-10a3-4926-a3f9-4c583d71ebe8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081151 Jul 29 13:10:19.214353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 649/1324] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:19 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:19.770492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:19.772612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:19.779153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:19.779602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:19.780366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:19.780804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:19.809481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-97bc2842-7461-4108-94d6-dc9b0748e803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043784 Jul 29 13:10:19.810065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 676/1325] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:20.235782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:20.236395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:20.242952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:20.243409 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:20.244177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:20.244621 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:20.304260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:20.311760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1897fc3a-d505-4bc5-ac2e-fded3b1917c1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080183 Jul 29 13:10:20.312335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 650/1326] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:20 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:20.822828 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:20.824960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:20.832300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:20.832818 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:20.833485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:20.833969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:20.868183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f02de014-1c14-4bd1-9e9d-e340c3c89db3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049360 Jul 29 13:10:20.868751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 677/1327] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:21.333684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:21.334341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:21.340813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:21.341270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:21.342072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:21.342517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:21.407076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:21.414577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bda78eea-674b-4891-9cef-1a298948a1fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085435 Jul 29 13:10:21.415139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 651/1328] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:21 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:21.880593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:21.882800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:21.889338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:21.889791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:21.890595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:21.891038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:21.920683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-44943d99-03a4-473c-b2bf-1f092d9143bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044051 Jul 29 13:10:21.921231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 678/1329] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:22.436371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:22.436895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:22.444105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:22.444556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:22.445316 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:22.445762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:22.506841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:22.514280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-685311a1-72dc-4a74-a8ef-d5fb34834b6d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081818 Jul 29 13:10:22.514843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 652/1330] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:22 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:22.932584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:22.935099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:22.942628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:22.943082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:22.943846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:22.944289 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:22.973324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d6a84371-e481-48d6-acaa-a1bb1b0e92c0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044691 Jul 29 13:10:22.973885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 679/1331] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:23.534858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:23.535490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:23.537629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=56 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:23.542859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:23.543303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:23.544053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:23.544518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:23.604523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:23.612168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fe2d9b09-b9d0-4629-9ec9-db7af5e9094c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081249 Jul 29 13:10:23.612725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 653/1332] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:23 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:23.986101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:23.988215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:23.994681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:23.995126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:23.995877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:23.996316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:24.025233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7cc9b775-5e51-4679-a398-ce3ae1cdfff4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043971 Jul 29 13:10:24.025776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 680/1333] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:24.632990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:24.633609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:24.640150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:24.640605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:24.641367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:24.642338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:24.702190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:24.710331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-46ed8056-a5d2-4754-9781-0309f05dbc40 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081231 Jul 29 13:10:24.710892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 654/1334] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:24 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:25.036681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:25.039050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:25.041734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=56 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:25.047109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:25.047554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:25.048333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:25.048767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:25.078269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9a5050af-5839-42ce-86b1-681788b1abce tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045582 Jul 29 13:10:25.078818 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 681/1335] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:25.731730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:25.732339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:25.739703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:25.740161 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:25.740928 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:25.741373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:25.803955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:25.811402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b36b3610-48fc-4ce2-bf18-534fdf1b5a5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083604 Jul 29 13:10:25.811969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 655/1336] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:25 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:26.091312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:26.093482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:26.103047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:26.103767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:26.104999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:26.105726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:26.136889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b9295502-a70f-41a0-bd6e-d813e5cc1eea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049557 Jul 29 13:10:26.137442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 682/1337] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:26.831912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:26.833014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:26.839141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:26.839589 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:26.840346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:26.840780 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:26.901083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:26.908499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cb4d721e-e2f2-4d39-a0ce-7f63704e0446 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080486 Jul 29 13:10:26.909074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 656/1338] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:26 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:27.148908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:27.151081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:27.157664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:27.158157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:27.158930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:27.159369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:27.189112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7ec23734-714d-41db-ac20-4a65d420639d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043668 Jul 29 13:10:27.189662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 683/1339] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:27.928951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:27.929563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:27.936199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:27.936653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:27.937429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:27.937892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:27.941767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:28.000593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:28.008163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-889cb8da-ee8a-4af1-8f0c-2a86c5875d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083149 Jul 29 13:10:28.008733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 657/1340] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:27 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:28.200773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:28.202855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:28.209885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:28.210343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:28.211107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:28.211548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:28.241555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:28.248547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9026da1b-ca57-488b-9b59-562314c78a97 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051810 Jul 29 13:10:28.249116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 684/1341] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:29.028387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:29.029020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:29.036255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:29.036700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:29.037458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:29.037922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:29.093539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:10:29.093788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:10:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:10:29.098417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:29.106447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-046e382c-19b9-4432-b56a-77e331246115 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081876 Jul 29 13:10:29.107009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 658/1342] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:29 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:29.261015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:29.263451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:29.270413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:29.270866 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:29.271631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:29.272072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:29.302885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-349a0ff8-6635-4393-942c-a52deabe40cf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046008 Jul 29 13:10:29.303457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 685/1343] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:30.128188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:30.128798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:30.135279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:30.135733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:30.136494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:30.136930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:30.207652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:30.215199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-76af3a64-11f4-4d08-b0b6-30eb17bda09a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.091379 Jul 29 13:10:30.215755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 659/1344] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:30 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:30.315839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:30.318033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:30.324745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:30.325199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:30.326241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:30.326687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:30.356511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9fe98380-ca21-47a1-8d19-a691e047a975 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045453 Jul 29 13:10:30.357051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 686/1345] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:31.236394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:31.236997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:31.243474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:31.243918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:31.244669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:31.245102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:31.306616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:31.314677 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e27e1491-e424-4892-8f45-cdee5636549d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082880 Jul 29 13:10:31.315234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 660/1346] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:31 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:31.369010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:31.371197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:31.377731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:31.378165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:31.378937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:31.379372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:31.409271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f48a62f1-fe1c-4f65-9fc5-70d17514d90a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044185 Jul 29 13:10:31.409843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 687/1347] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:32.335714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:32.336343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:32.342785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:32.343227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:32.344003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:32.344438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:32.406233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:32.413747 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6dbe9c19-7934-4c28-a75d-5a3c0f33b3b0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081865 Jul 29 13:10:32.414383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 661/1348] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:32 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:32.420876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:32.423093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:32.429481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:32.429972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:32.430736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:32.431175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:32.461978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8c43227f-510a-4785-a8d5-25d7c42262fe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045049 Jul 29 13:10:32.462533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 688/1349] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:33.434439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:33.434997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:33.442121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:33.442574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:33.443331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:33.443768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:33.473730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:33.476014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:33.482585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:33.483031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:33.483793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:33.484227 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:33.504778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:33.512630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-905261dc-ab0e-4f99-b268-43a21b1f3c10 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082099 Jul 29 13:10:33.513421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 662/1350] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:33 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:33.514629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-758d206c-0fe4-42a3-a112-cf3467dbfb37 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044732 Jul 29 13:10:33.515177 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 689/1351] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:10:34.527770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:34.530012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:34.533008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:34.533620 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:34.537081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:34.537541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:34.538351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:34.538805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:34.540012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:34.540466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:34.541223 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:34.541659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:34.568510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cf9c7fc8-2ea0-45f7-84de-23acd4f69d1a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044978 Jul 29 13:10:34.569079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 663/1352] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:34.602831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:34.610579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-03629051-c10d-40fa-a269-8045f3df24b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081925 Jul 29 13:10:34.611136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 690/1353] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:34 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:10:35.581368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:35.583570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:35.590156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:35.590612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:35.591386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:35.591829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:35.622763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-910e1e2e-72ca-4406-9c09-ff7dae8e2c8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045385 Jul 29 13:10:35.623331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 664/1354] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:35.631176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:35.631787 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:35.638282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:35.638730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:35.639486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:35.639917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:35.700847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:35.708935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b432aa2-4a66-41a1-95a4-8601927765b7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081636 Jul 29 13:10:35.709493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 691/1355] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:35 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:36.635393 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:36.637596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:36.644106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:36.644556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:36.645310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:36.645749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:36.676810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-08e3d17d-bf9f-474a-b3e9-29b2c36c2450 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045409 Jul 29 13:10:36.677366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 665/1356] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:36.730745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:36.731368 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:36.739004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:36.739520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:36.740354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:36.740799 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:36.800801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:36.808205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fe2ddb15-ef17-481a-9c00-eaeef0ce329a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081524 Jul 29 13:10:36.808766 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 692/1357] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:36 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:37.689137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:37.691298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:37.697679 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:37.698157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:37.698912 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:37.699345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:37.728122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2763e1d2-e86b-4530-93fd-86d5a40fd813 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043479 Jul 29 13:10:37.728653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 666/1358] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:37.830109 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:37.830727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:37.837319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:37.837777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:37.838572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:37.839011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:37.901709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:37.909300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1b308f1f-f65a-4ece-bb2d-9b4075c8ddc7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083790 Jul 29 13:10:37.909878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 693/1359] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:37 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:38.741140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:38.743299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:38.749719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:38.750203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:38.751597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:38.752038 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:38.780986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8671a025-b3d9-4383-af63-96cde1fb6da4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043786 Jul 29 13:10:38.781535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 667/1360] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:10:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:10:38.929525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:38.930200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:38.936653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:38.937108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:38.937894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:38.938895 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:38.998360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:39.006669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0cb8f9ee-c756-4367-8082-6f69c6aa7db8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081025 Jul 29 13:10:39.007230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 694/1361] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:38 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:39.793376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:10:39.795563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:39.803487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:39.803947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:39.804756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:39.805197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:39.879441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6b2665fc-f8ec-4320-998b-f60fc43c68ba tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/action" status: 200 len: 41364 microversion: 2.1 time: 0.090435 Jul 29 13:10:39.881938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 668/1362] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 13:10:39 2022] POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/action => generated 41364 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 13:10:40.027351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:40.027978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:40.034579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:40.035036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:40.035801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:40.036238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:40.099074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:40.106629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0b44f5a1-805d-48a8-96f6-6b03e53e0552 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083217 Jul 29 13:10:40.107192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 695/1363] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:40 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:41.129718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:41.130453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:41.137570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:41.138065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:41.138835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:41.139282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:41.200804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:41.208866 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-845c531f-65ee-4e35-bb40-ca32bbd5b4a7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084099 Jul 29 13:10:41.209433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 669/1364] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:41 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:42.228409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:42.229026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:42.235434 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:42.235882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:42.236625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:42.237055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:42.296774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:42.304169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aab94fe7-f523-4f09-a1de-8f03e1699fc2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079592 Jul 29 13:10:42.304727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 696/1365] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:42 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:43.325233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:43.325864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:43.332811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:43.333259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:43.334055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:43.334497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:43.394843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:43.402302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c5b1ced5-d394-461e-95ca-9cc0ab21ff5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080907 Jul 29 13:10:43.402885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 670/1366] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:43 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:44.425708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:44.426284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:44.432783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:44.433234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:44.434033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:44.434474 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:44.498468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:44.507089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6207f76a-30cb-45b3-b1c5-8ccbd6594d16 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086300 Jul 29 13:10:44.507779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 697/1367] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:44 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:45.528834 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:45.529401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:45.536518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:45.536975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:45.537737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:45.538205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:45.597846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:45.605186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9e2a65ea-ff1a-4333-acf8-1b3054dec6ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080281 Jul 29 13:10:45.605751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 671/1368] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:45 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:46.626213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:46.626845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:46.633219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:46.633669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:46.634457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:46.634907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:46.921461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:46.929649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-77a54082-1966-454a-9a3d-901703a9e1a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.307419 Jul 29 13:10:46.930240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 698/1369] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:46 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:47.950260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:47.950852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:47.957334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:47.957779 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:47.958556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:47.958990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:48.021902 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:48.029323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0ea1a208-3e43-49b1-85d5-8b747f87c605 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082942 Jul 29 13:10:48.029974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 672/1370] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:47 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:49.051010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:49.051554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:49.058466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:49.058924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:49.059690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:49.060129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:49.122702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:49.130737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9296c858-8b5a-4d38-b00b-896a6a2cbf5e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083645 Jul 29 13:10:49.131298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 699/1371] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:49 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:50.152251 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:50.152867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:50.160097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:50.160580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:50.161343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:50.161786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:50.223468 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:50.230908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6be90067-e8af-400f-bf3d-77e355a7f275 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082496 Jul 29 13:10:50.231470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 673/1372] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:51.251916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:51.252537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:51.259033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:51.259488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:51.260249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:51.260689 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:51.324708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:51.334355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49e1eda4-eaa2-48af-9950-275a96e5b3e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086281 Jul 29 13:10:51.334931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 700/1373] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:52.357124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:52.357737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:52.364531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:52.364995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:52.365758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:52.366223 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:52.370246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=100 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:52.427286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:52.435257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-47514a4f-2ce9-4a89-be91-6807949dea8b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082013 Jul 29 13:10:52.435820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 674/1374] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:52 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:53.456166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:53.456722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:53.463279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:53.463730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:53.464487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:53.464923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:53.479951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=100 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:53.526236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:53.534194 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a27e8d5b-640a-4ebd-bc28-1a003cc71d60 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082045 Jul 29 13:10:53.534752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 701/1375] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:53 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:54.554229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:54.554835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:54.557142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=44 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:54.562465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:54.563506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:54.564263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:54.564696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:54.624530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:54.632768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6d2ce84d-e7e2-43d7-8014-ac230d9ba7ca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082407 Jul 29 13:10:54.633342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 675/1376] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:54 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:55.654528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:55.655144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:55.657447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=42 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:10:55.662851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:55.663302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:55.664066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:55.664502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:55.730543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:55.738158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-54538abb-9a99-4a03-ae6d-b79d49924710 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087418 Jul 29 13:10:55.738720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 702/1377] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:55 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:56.759779 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:56.760348 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:56.767103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:56.767559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:56.768328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:56.768770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:56.831546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:56.838999 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1d32af82-21e0-4710-9e66-3319e37611dc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083220 Jul 29 13:10:56.839610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 676/1378] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:57.864157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:57.864784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:57.871294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:57.871738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:57.872489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:57.872921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:57.933591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:57.941518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-60da29d7-9420-4839-8d14-ce158a3b16f2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081545 Jul 29 13:10:57.942108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 703/1379] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:10:58.964411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:10:58.965066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:10:58.972821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:58.973645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:58.974556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:10:58.975006 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:10:59.036590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:10:59.044029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5dd8037f-0b6d-4442-8c88-9fa15d4d407f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084776 Jul 29 13:10:59.044597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 677/1380] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:10:58 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:00.064643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:00.065260 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:00.072297 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:00.072754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:00.073508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:00.073983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:00.136033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:00.144111 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8deefce6-d2aa-4725-8d88-de841c816e19 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083831 Jul 29 13:11:00.144672 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 704/1381] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:01.164624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:01.165242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:01.172387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:01.172840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:01.173604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:01.174071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:01.234526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:01.242201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8221b14c-1820-4c90-b718-8304d5b7c4ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081396 Jul 29 13:11:01.242762 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 678/1382] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:01 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:02.262961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:02.263605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:02.270653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:02.271102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:02.271855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:02.272290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:02.332723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:02.340137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8c03939d-1459-4a46-a6e0-f8733b46b95c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081051 Jul 29 13:11:02.340698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 705/1383] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:03.361401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:03.362064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:03.368675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:03.369132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:03.369946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:03.370394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:03.435419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:03.443052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bb273f33-e340-46bd-b409-1c8386ba6d31 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086370 Jul 29 13:11:03.443646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 679/1384] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:03 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:04.464518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:04.465138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:04.472265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:04.472721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:04.473520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:04.473998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:04.537802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:04.545413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ecf3add8-4535-4a89-a08c-9cbf1b62a5ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084747 Jul 29 13:11:04.546006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 706/1385] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:04 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:05.566541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:05.567157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:05.573614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:05.574102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:05.574877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:05.575318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:05.638978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:05.647648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-50ccfcf4-4cab-4df0-96f2-af8c3b3be444 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085565 Jul 29 13:11:05.648219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 680/1386] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:05 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:06.672188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:06.673392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:06.683366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:06.683819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:06.684597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:06.685031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:06.749312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:06.756758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-626e298b-ee0f-484a-a74f-c14efa5a9ed1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.092030 Jul 29 13:11:06.757313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 707/1387] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:06 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:07.778423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:07.779021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:07.785601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:07.786082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:07.786839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:07.787275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:07.847004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:07.854464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-22daf500-d0b2-4f78-8f83-18bb588102ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079862 Jul 29 13:11:07.855017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 681/1388] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:08.876124 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:08.876734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:08.883174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:08.883623 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:08.884372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:08.884804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:08.947087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:08.954503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cf369c14-5c1b-41ee-b739-bdd9c78f6c7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082840 Jul 29 13:11:08.955062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 708/1389] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:08 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:09.974972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:09.975581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:09.982082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:09.982541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:09.983306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:09.983750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:10.044123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:10.051606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2c3182ea-e50e-400b-b64d-ec933d16db69 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080631 Jul 29 13:11:10.052178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 682/1390] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:09 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:11.072192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:11.072809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:11.079470 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:11.079919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:11.080824 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:11.082466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:11.146146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:11.153691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0d161447-420c-4759-aa05-b7391e4a4654 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085385 Jul 29 13:11:11.154279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 709/1391] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:11 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:12.175263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:12.175873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:12.182053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:12.182510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:12.183279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:12.183721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:12.243495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:12.251439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a8e61b0a-6dd6-4661-8258-22467257511c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080901 Jul 29 13:11:12.252005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 683/1392] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:12 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:13.271658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:13.272274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:13.278551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:13.279007 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:13.279772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:13.280212 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:13.343155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:13.351231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d5835334-2b87-413e-8301-b93161d2d962 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083486 Jul 29 13:11:13.351790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 710/1393] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:13 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:14.372363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:14.372883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:14.381705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:14.382514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:14.383817 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:14.384556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:14.464940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:14.472591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e00c1368-138f-4abc-9dbb-5518759d3262 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.104166 Jul 29 13:11:14.473159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 684/1394] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:14 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:15.493502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:15.494072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:15.501101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:15.501551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:15.502343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:15.502796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:15.565025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:15.572430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f03285f1-d895-4ec7-b3fa-cd960a2695b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082926 Jul 29 13:11:15.572995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 711/1395] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:15 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:16.593056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:16.593711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:16.600313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:16.600766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:16.601539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:16.602013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:16.662059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:16.669374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6e91d454-9b8b-4a47-b1b9-5ef07c3886b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080245 Jul 29 13:11:16.669967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 685/1396] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:16 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:17.691148 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:17.691770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:17.698350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:17.698803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:17.699564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:17.700004 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:17.760936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:17.768862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-98f75a34-de2a-4584-bcdb-8bcffdc60bad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081607 Jul 29 13:11:17.769425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 712/1397] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:17 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:18.789581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:18.790233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:18.796812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:18.797254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:18.798061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:18.798507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:18.860279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:18.868200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-22764d35-42bf-4a05-ba12-a3ab613f207d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082518 Jul 29 13:11:18.868761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 686/1398] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:18 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:19.889174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:19.889787 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:19.896909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:19.897364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:19.898181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:19.898621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:19.959669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:19.967133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d71131fe-005c-48e6-96b2-fa73f6835094 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081847 Jul 29 13:11:19.967701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 713/1399] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:19 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:20.988940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:20.989500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:20.996048 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:20.996501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:20.997276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:20.997719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:21.058528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:21.066685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-06d106c9-86e6-41c3-8aec-c281c3b1a3e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082690 Jul 29 13:11:21.067254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 687/1400] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:20 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:22.086809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:22.087407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:22.094126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:22.094582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:22.095345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:22.095791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:22.166353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:22.174441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c8ef87e1-083a-4566-8edf-127dc7c80a3b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.091773 Jul 29 13:11:22.175009 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 714/1401] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:22 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:23.195067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:23.195678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:23.202320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:23.202776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:23.203532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:23.203971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:23.206507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:23.267410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:23.274841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f0635502-6a9a-4c4a-8ffc-0dee4873ba2c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083627 Jul 29 13:11:23.275402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 688/1402] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:23 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:24.296028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:24.296635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:24.303193 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:24.303647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:24.304409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:24.304843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:24.308761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=82 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:24.368651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:24.376658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c1a64b4a-93e5-4504-b6c1-69aabc2dcf26 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084492 Jul 29 13:11:24.377162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 715/1403] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:24 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:25.397524 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:25.398164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:25.400383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:25.406289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:25.406758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:25.407521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:25.407958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:25.470314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:25.477896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4e444e24-1d5c-495a-8713-4b410c7a7ccc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084325 Jul 29 13:11:25.478464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 689/1404] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:25 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:26.498957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:26.500135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:26.502463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:26.507928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:26.508481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:26.509245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:26.509680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:26.570987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:26.579078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1a4927b1-cc18-4dfa-bd9a-7ba5bedf5d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083971 Jul 29 13:11:26.579660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 716/1405] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:26 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:27.600025 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:27.600695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:27.607360 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:27.607813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:27.608577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:27.609527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:27.671107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:27.679100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2c26c260-7c52-497c-bb23-175230054392 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083005 Jul 29 13:11:27.679669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 690/1406] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:27 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:28.700564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:28.701178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:28.707781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:28.708230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:28.708991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:28.709426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:28.769713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:28.777309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-928c8374-29c6-4cc6-892a-cffca9f71ada tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080598 Jul 29 13:11:28.777890 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 717/1407] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:28 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:29.798710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:29.799361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:29.806540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:29.807056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:29.807944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:29.808389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:29.877996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:29.885477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-be51bbd8-f637-4927-86d7-15821e919b0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.091249 Jul 29 13:11:29.886071 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 691/1408] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:29 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:30.906595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:30.907213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:30.913947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:30.914404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:30.915170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:30.915611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:30.981394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:30.989847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-af1a2cce-4311-4a22-a208-f8e5597e0cda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087652 Jul 29 13:11:30.990419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 718/1409] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:30 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:32.010494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:32.011247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:32.018212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:32.018669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:32.019432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:32.019906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:32.083240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:32.090711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-709c93e1-a2fa-4703-862f-d3280bd16d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084097 Jul 29 13:11:32.091276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 692/1410] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:32 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:33.112465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:33.113114 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:33.119913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:33.120313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:33.121087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:33.121533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:33.182144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:33.189652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fa7b85c7-0c5b-4a46-a27c-a1322a5c08f5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082164 Jul 29 13:11:33.190261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 719/1411] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:33 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:34.210419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:34.211030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:34.217630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:34.218788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:34.219552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:34.219997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:34.283272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:34.290715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2f510136-a526-4b81-a555-f88a1cbae63e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084157 Jul 29 13:11:34.291275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 693/1412] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:34 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:35.312702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:35.313300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:35.321404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:35.322216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:35.323407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:35.323838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:35.388633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:35.396847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fb32e3b9-7a7b-4014-acbe-9565a7f636bb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.089077 Jul 29 13:11:35.397397 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 720/1413] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:35 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:36.418105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:36.418649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:36.425662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:36.426139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:36.426889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:36.427323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:36.488434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:36.495925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ac122dc1-4a36-4f19-9870-f2cf81f0147d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081738 Jul 29 13:11:36.496490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 694/1414] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:36 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:37.516713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:37.517289 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:37.523975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:37.524437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:37.525244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:37.525666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:37.590340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:37.598604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9c37f12c-35f1-475e-afbb-5ed46c2dd26c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085882 Jul 29 13:11:37.599163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 721/1415] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:37 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:38.620061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:38.620678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:38.627699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:38.628152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:38.628919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:38.629361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:38.689971 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:38.697611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e6af7649-a4ee-4dda-bffd-d86f67c959e0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081399 Jul 29 13:11:38.698210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 695/1416] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:38 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:39.720867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:39.721482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:39.728037 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:39.728488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:39.729247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:39.729682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:39.795153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:39.802596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-78479386-e579-4db0-9ff3-1c93108b0092 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086290 Jul 29 13:11:39.803160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 722/1417] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:39 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:40.822821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:40.823431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:40.829607 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:40.830096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:40.830858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:40.831297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:40.893235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:40.901301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-55b03fd1-beb1-4002-b60f-32b969d24d01 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082186 Jul 29 13:11:40.901935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 696/1418] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:40 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:11:41.922948 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:41.923574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:41.929544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:41.930028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:41.930778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:41.931206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:41.991333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:41.998726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d6e4047b-f2d1-499b-840d-526909188033 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079789 Jul 29 13:11:41.999314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 723/1419] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:41 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:43.020030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:43.020646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:43.027270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:43.027726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:43.028499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:43.028942 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:43.095737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:43.103369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1f7a819e-37c0-4f11-8e34-3ff31a0bbeb0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087237 Jul 29 13:11:43.103937 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 697/1420] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:43 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:11:44.125005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:44.125619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:44.132274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:44.132723 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:44.133478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:44.133942 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:44.193908 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:44.201264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7c51db46-de15-4601-bc7e-c54b28ab32ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080764 Jul 29 13:11:44.201836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 724/1421] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:44 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:45.224453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:45.225160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:45.232637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:45.233156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:45.234593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:45.235387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:45.307682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:45.315857 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-45641729-3910-42dd-8716-26097b4af27c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.097246 Jul 29 13:11:45.316426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 698/1422] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:45 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:46.336579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:46.337218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:46.344378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:46.344834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:46.345594 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:46.346066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:46.406726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:46.414168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2c454e4b-5f67-45b8-9580-9265b3827a2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081451 Jul 29 13:11:46.414728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 725/1423] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:46 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:47.434929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:47.435528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:47.442095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:47.442553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:47.443317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:47.443784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:47.504250 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:47.511617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5be9f852-2d9a-41ab-9c55-98ce570a12e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080562 Jul 29 13:11:47.512178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 699/1424] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:47 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:48.533437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:48.534021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:48.540466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:48.540920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:48.541684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:48.542150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:48.605236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:48.613572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a3c8c092-cc90-4a47-b4a9-40c2fe09ad46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084689 Jul 29 13:11:48.614180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 726/1425] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:48 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:48.638463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:11:48.638944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:11:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:11:49.634878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:49.635516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:49.642732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:49.643317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:49.643947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:49.644396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:49.707924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:49.715350 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-113a7d38-6359-41ba-a6e7-e0c6c3abec23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084321 Jul 29 13:11:49.715907 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 700/1426] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:49 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:50.736840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:50.737465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:50.743971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:50.744429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:50.745191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:50.745632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:50.806016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:50.813511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e174acbd-a6ac-4d9f-b0f5-eef7fd63fd2f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080888 Jul 29 13:11:50.814115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 727/1427] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:51.834458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:51.835146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:51.847858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:51.848314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:51.849290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:51.850052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:51.920141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:51.928155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-12fc125e-e4f0-4f43-ad48-8fdae00e11e6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.097575 Jul 29 13:11:51.928725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 701/1428] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:52.951756 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:52.953036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:52.962110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:52.962573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:52.963346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:52.963785 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:53.026333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:53.034552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4c4d7883-118d-4f07-92a6-b164634afa36 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086758 Jul 29 13:11:53.035122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 728/1429] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:52 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:54.055192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:54.055818 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:54.062878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:54.063324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:54.064079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:54.064509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:54.067032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:54.129784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:54.137352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fe908f0f-6a44-4298-a506-15f16182b11d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085984 Jul 29 13:11:54.137944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 702/1430] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:54 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:55.157501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:55.158082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:55.164638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:55.165085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:55.165870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:55.166307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:55.168839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:55.234236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:55.242034 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2f7325cd-c134-4ef9-9cc6-447bfa217475 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.088438 Jul 29 13:11:55.242598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 729/1431] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:55 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:56.262915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:56.263535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:56.266556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:56.271879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:56.272335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:56.273106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:56.273549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:56.341209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:56.348760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c6679bdd-c447-4a34-b616-255366268876 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.089998 Jul 29 13:11:56.349320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 703/1432] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:57.369055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:57.369664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:57.372021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:11:57.377925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:57.378371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:57.379136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:57.379574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:57.448876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:57.456573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4c8c75de-8f03-407d-9110-7ada3ce7796e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.091327 Jul 29 13:11:57.457143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 730/1433] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:58.477337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:58.477930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:58.484324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:58.484778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:58.485539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:58.486026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:58.546832 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:58.554190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-09acf4bc-4876-4223-b523-225c4511a3b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080800 Jul 29 13:11:58.554749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 704/1434] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:58 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:11:59.575616 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:11:59.576232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:11:59.582906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:59.583357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:59.584129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:11:59.584567 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:11:59.645986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:11:59.653528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4390d195-eb67-4010-b109-d125f96fa009 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081832 Jul 29 13:11:59.654128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 731/1435] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:11:59 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:00.675535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:00.676153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:00.682669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:00.683130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:00.683909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:00.684452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:00.755960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:00.764135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3216ecde-b70a-4954-a77b-40e96026542e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.093421 Jul 29 13:12:00.764690 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 705/1436] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:01.784510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:01.785150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:01.791813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:01.792264 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:01.793019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:01.793457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:01.855125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:01.863497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3582b880-1a90-4e06-b974-cdb09a1510b6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083372 Jul 29 13:12:01.864067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 732/1437] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:01 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:02.884453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:02.885052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:02.891534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:02.891976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:02.892743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:02.893160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:02.958969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:02.966399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-54f3f9ca-1ddb-4f21-8f6e-2c7b0d94bdf4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085795 Jul 29 13:12:02.966958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 706/1438] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:03.987192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:03.987808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:03.994530 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:03.994981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:03.995747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:03.996186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:04.057128 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:04.065272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3cbf9676-a4e8-4c40-b4b2-f68d2745c20a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082204 Jul 29 13:12:04.065834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 733/1439] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:03 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:05.086525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:05.087140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:05.093682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:05.094185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:05.094979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:05.095419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:05.157934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:05.165399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9626c074-7e12-4720-b792-513f84ce1792 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082759 Jul 29 13:12:05.165974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 707/1440] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:05 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:06.187116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:06.187736 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:06.194410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:06.194865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:06.195629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:06.196071 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:06.259384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:06.267420 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1f4c6653-d777-4576-8509-8d11f115bd5a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084655 Jul 29 13:12:06.267990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 734/1441] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:06 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:12:07.288070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:07.288641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:07.295331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:07.295783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:07.296540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:07.296978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:07.356904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:07.364658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8d262ba3-affa-4dfc-847f-92e295542f70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080527 Jul 29 13:12:07.365220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 708/1442] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:08.146637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:12:08.147129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:12:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:12:08.385230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:08.385769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:08.393239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:08.393701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:08.394571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:08.395061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:08.467232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:08.474952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5552d24e-4893-4dc8-afd3-f59f96816f98 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.093726 Jul 29 13:12:08.475521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 735/1443] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:08 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:09.495768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:09.496361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:09.502850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:09.503296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:09.504082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:09.504519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:09.565156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:09.572655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-49e2c7bc-943a-47f4-93d7-732dbbec08fb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080736 Jul 29 13:12:09.573222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 709/1444] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:09 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:10.593478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:10.594129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:10.600600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:10.601049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:10.601805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:10.602262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:10.662813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:10.670237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3c9d937e-32d4-41ff-a334-6d7952973a52 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080645 Jul 29 13:12:10.670794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 736/1445] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:10 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:11.503282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:12:11.503813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:12:11.691458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:11.691981 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:11.698104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:11.698566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:11.699327 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:11.699768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:11.763021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:11.770660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-df4d2419-37ce-4fb5-8111-f1f30377db5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083296 Jul 29 13:12:11.771222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 710/1446] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:11 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:12.791527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:12.792144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:12.798287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:12.798739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:12.799505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:12.799945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:12.860030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:12.867853 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-657c649e-53a1-471b-bd2a-f386425a2424 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080438 Jul 29 13:12:12.868414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 737/1447] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:12 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:13.888598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:13.889887 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:13.896320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:13.896774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:13.897532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:13.898005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:13.958639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:13.966488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4e928592-972e-4d75-97f0-1a6de9e8656c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081808 Jul 29 13:12:13.967054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 711/1448] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:13 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:14.987217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:14.987837 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:14.994370 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:14.994830 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:14.995595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:14.996038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:15.060028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:15.068069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b36ba71e-8a49-409b-9f75-f1a826fb98e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084975 Jul 29 13:12:15.068632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 738/1449] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:14 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:16.089282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:16.089925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:16.096503 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:16.096959 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:16.097721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:16.098192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:16.166455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:16.176233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-59aba3db-08bc-496c-9cc1-7ac632b36882 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.090762 Jul 29 13:12:16.177009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 712/1450] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:16 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:17.199465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:17.200010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:17.206596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:17.207039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:17.207788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:17.208218 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:17.268458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:17.275937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c9c0ef34-5d1a-4219-b671-13cfb0f9a681 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080366 Jul 29 13:12:17.276497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 739/1451] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:17 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:12:18.297340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:18.297989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:18.304550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:18.305010 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:18.305778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:18.306249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:18.365672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:18.373173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cb25dbb1-7da7-4d06-bb26-4aa56907a362 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080312 Jul 29 13:12:18.373674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 713/1452] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:18 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:19.394501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:19.395045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:19.401480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:19.401964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:19.402715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:19.403146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:19.463066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:19.471095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ea3e42d5-3824-4acb-a3f6-08b30aff7d39 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081119 Jul 29 13:12:19.471643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 740/1453] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:19 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:20.491847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:20.492369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:20.498839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:20.499812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:20.500572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:20.501013 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:20.563756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:20.571293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f44861e0-a03a-4ba2-ab92-868c89587d28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083408 Jul 29 13:12:20.571848 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 714/1454] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:20 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:21.592628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:21.593814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:21.600328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:21.600784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:21.601547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:21.602025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:21.665408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:21.673165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3821e195-4c08-40b6-b605-028cba030db7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084408 Jul 29 13:12:21.673730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 741/1455] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:21 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:22.693952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:22.694574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:22.701059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:22.701517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:22.703054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:22.703508 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:22.768844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:22.776178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2d3ae20c-3447-4e6f-970d-a99fa131880e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086145 Jul 29 13:12:22.776727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 715/1456] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:22 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:23.613683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:12:23.614315 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:12:23.798168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:23.798785 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:23.805286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:23.805755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:23.806541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:23.806979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:23.875425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:23.886001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0a39ca07-81fc-47ce-a100-5e2aebacca0e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.092093 Jul 29 13:12:23.886630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 742/1457] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:23 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:24.908538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:24.909152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:24.915751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:24.916210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:24.916978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:24.917419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:24.921341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:24.978257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:24.985689 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-94751253-1a2a-4f6c-b0ed-e072da3a17b3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081092 Jul 29 13:12:24.986277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 716/1458] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:24 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:26.006768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:26.007362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:26.013897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:26.014379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:26.015143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:26.015598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:26.020026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:26.080417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:26.087450 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-39c7ec19-b8f8-4b4b-9e96-40affd62d2e4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084517 Jul 29 13:12:26.088019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 743/1459] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:26 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:27.108775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:27.109365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:27.111980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:27.117512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:27.117998 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:27.118774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:27.119218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:27.179435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:27.186794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-15e12cc2-3ca9-4b01-a528-c14e9cd2825c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081966 Jul 29 13:12:27.187358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 717/1460] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:27 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:28.208025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:28.208638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:28.211057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:28.216422 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:28.216871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:28.217633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:28.218098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:28.278922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:28.286437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ad307023-b46f-4237-af2a-e70bbdbcd0fd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082262 Jul 29 13:12:28.286995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 744/1461] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:28 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:29.307661 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:29.308275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:29.314955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:29.315413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:29.316180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:29.316623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:29.378860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:29.386370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d962f71f-31b7-4d6f-8dda-3f982319b612 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082672 Jul 29 13:12:29.386939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 718/1462] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:29 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:30.408656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:30.409219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:30.415704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:30.416153 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:30.416943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:30.417369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:30.477439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:30.484923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-96f06486-622c-4e08-83b8-3a1057e553c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080228 Jul 29 13:12:30.485489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 745/1463] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:30 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:31.506677 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:31.507243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:31.513725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:31.514631 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:31.515407 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:31.515847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:31.577434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:31.585651 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f70f53de-26b7-4d53-84d6-5fedfc56ca76 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082894 Jul 29 13:12:31.586238 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 719/1464] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:31 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:32.606695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:32.607338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:32.614664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:32.615120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:32.615909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:32.616329 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:32.682928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:32.691145 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fe594b66-883f-4654-9169-063d67f6eb30 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.088427 Jul 29 13:12:32.691705 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 746/1465] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:32 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:12:33.711642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:33.712247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:33.718708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:33.719166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:33.719925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:33.720366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:33.784104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:33.791612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-02cce388-2441-424b-aaac-0e9ec8569342 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083826 Jul 29 13:12:33.792183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 720/1466] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:33 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:34.812527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:34.813120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:34.820374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:34.820819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:34.821579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:34.822064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:34.884678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:34.892572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-533199be-a50b-47d7-aa26-7247e2b40153 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083869 Jul 29 13:12:34.893131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 747/1467] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:34 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:35.912980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:35.913585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:35.920044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:35.920499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:35.921259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:35.921699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:35.985955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:35.994052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-93c7f97d-c006-487f-8cb0-b0e058d2b215 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084802 Jul 29 13:12:35.994614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 721/1468] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:35 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:37.015188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:37.015804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:37.022404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:37.022857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:37.023626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:37.024064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:37.089916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:37.098146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a02a17d7-7761-4fbc-999c-85427fe4a266 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086833 Jul 29 13:12:37.098705 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 748/1469] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:37 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:38.118904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:38.119548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:38.126076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:38.126534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:38.127875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:38.128311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:38.191268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:38.198739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-943abb08-f046-472e-abfb-08404e14673a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083857 Jul 29 13:12:38.199295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 722/1470] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:38 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:39.219048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:39.219601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:39.226138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:39.226587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:39.227341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:39.227774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:39.288241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:39.295593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9fe65267-7f36-48ec-8c1b-bb06539754be tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080532 Jul 29 13:12:39.296157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 749/1471] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:39 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:40.321437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:40.321437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:40.323633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:40.324097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:40.324875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:40.325323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:40.388559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:40.397101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5ad9050d-4d8b-4ff5-a1f5-e1af240b6e58 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084734 Jul 29 13:12:40.397672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 723/1472] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:40 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:41.417899 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:41.418518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:41.425245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:41.425702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:41.426490 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:41.426931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:41.490227 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:41.497717 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dc16b696-d224-4806-a1f0-f4ae1fd1be9f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083852 Jul 29 13:12:41.498311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 750/1473] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:41 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:42.518734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:42.519268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:42.525963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:42.526427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:42.527227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:42.527676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:42.588196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:42.596087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-32ce5685-2cc8-4e0b-b09e-8ec20ef865f1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081483 Jul 29 13:12:42.596738 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 724/1474] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:42 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:43.618337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:43.618944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:43.625644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:43.626135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:43.626939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:43.627379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:43.688248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:43.695849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3cabf81b-e8ab-42d9-8776-cbef4b4aa516 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081352 Jul 29 13:12:43.696417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 751/1475] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:43 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:44.716377 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:44.717009 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:44.724143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:44.724592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:44.725370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:44.725801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:44.789629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:44.797282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-997eb5a7-0897-4cef-8ecc-354e025a2514 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084826 Jul 29 13:12:44.797876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 725/1476] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:44 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:45.817781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:45.818401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:45.824885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:45.825329 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:45.826104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:45.826535 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:45.887074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:45.894576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f274f2c1-d83e-436f-9523-813294feea8c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080894 Jul 29 13:12:45.895137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 752/1477] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:45 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:46.915243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:46.915861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:46.922516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:46.922973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:46.924248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:46.924691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:46.987238 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:46.994650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-34605221-4360-4baa-ace4-377d99f23d74 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083251 Jul 29 13:12:46.995221 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 726/1478] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:46 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:48.016134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:48.016794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:48.024096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:48.024543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:48.025306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:48.025747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:48.086053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:48.093538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-09bb3524-3e08-434a-864c-748b501e3965 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081379 Jul 29 13:12:48.094133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 753/1479] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:48 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:49.114449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:49.115083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:49.121746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:49.122172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:49.122940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:49.123379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:49.183734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:49.191152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-867516b2-3db3-4a9f-aeaa-9b9d3814f9ed tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080908 Jul 29 13:12:49.191713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 727/1480] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:49 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:50.211712 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:50.212356 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:50.218980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:50.219432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:50.220803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:50.221253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:50.285087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:50.292613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4184205a-6d45-4438-ad63-4048a025c80f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084744 Jul 29 13:12:50.293171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 754/1481] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:51.378682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:51.379289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:51.385254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:51.385701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:51.386501 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:51.386934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:51.447882 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:51.455295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-979974cb-f996-4a4c-813c-f9216979c745 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.146202 Jul 29 13:12:51.455850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 728/1482] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:52.476500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:52.477070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:52.483652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:52.484103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:52.484867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:52.485306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:52.548000 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:52.555893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-acb411ce-e919-4a49-bd8f-49f4c5228411 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083375 Jul 29 13:12:52.556463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 755/1483] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:52 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:53.576515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:53.577133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:53.584399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:53.584891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:53.585710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:53.586233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:53.650027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:53.658388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8d97ca72-eb51-4f51-bbfa-e48265df893d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085072 Jul 29 13:12:53.658949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 729/1484] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:53 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:54.679821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:54.680431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:54.688008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:54.688462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:54.689860 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:54.690290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:54.751276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:54.758680 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-af40bfa5-393c-47e1-9565-7244416f84d0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082735 Jul 29 13:12:54.759240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 756/1485] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:54 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:55.778778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:55.779395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:55.786516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:55.786977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:55.787751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:55.788190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:55.790773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:55.851420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:55.858880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-88ffe6c3-75fd-46c9-8157-bc994b2f63fe tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083980 Jul 29 13:12:55.859444 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 730/1486] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:55 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:56.880270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:56.880910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:56.887414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:56.887864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:56.888621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:56.889058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:56.892934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:56.950909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:56.958372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4dda30ab-4f6a-4e83-8d01-06d14c3c7d5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082542 Jul 29 13:12:56.958934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 757/1487] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:57.979058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:57.979650 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:57.981940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:57.987778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:57.988222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:57.988970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:57.989403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:58.053629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:58.061260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1179fa2c-a456-4793-a0e7-ddd63ac68cca tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086026 Jul 29 13:12:58.061954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 731/1488] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:12:59.082890 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:12:59.083505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:12:59.085845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:12:59.091179 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:59.091637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:59.092408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:12:59.092851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:12:59.158472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:12:59.166299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-71ff8aa3-be83-428a-a83c-674d9a6685c3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087626 Jul 29 13:12:59.166803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 758/1489] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:12:59 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:00.187592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:00.188209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:00.195276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:00.195730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:00.196499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:00.196938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:00.264307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:00.272469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8e7745c8-9995-4f4d-b75b-2eac25d70b94 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.088771 Jul 29 13:13:00.273037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 732/1490] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:01.293021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:01.293638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:01.300166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:01.300612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:01.301360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:01.301789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:01.362282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:01.369627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-749da768-3fa9-49e0-8db9-c8809d48d76d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080483 Jul 29 13:13:01.370738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 759/1491] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:01 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:02.390536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:02.391148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:02.398319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:02.398775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:02.399547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:02.399990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:02.462074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:02.469587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3d6a1336-c3b0-4099-a9d7-cc9f35fe8232 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083012 Jul 29 13:13:02.470225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 733/1492] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:03.491158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:03.491761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:03.498312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:03.498756 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:03.499516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:03.499949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:03.561740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:03.570384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ae5cca41-2c74-4f16-a857-975efa66db91 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083332 Jul 29 13:13:03.570961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 760/1493] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:03 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:04.590896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:04.591632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:04.598572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:04.599030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:04.599798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:04.600242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:04.662171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:04.669586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ff18e139-c157-4c17-a68f-68deea05f959 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082570 Jul 29 13:13:04.670188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 734/1494] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:04 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:13:05.692465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:05.693107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:05.699611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:05.700093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:05.700851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:05.701285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:05.763553 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:05.771466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1a68fe75-139b-4e69-903c-904f0af11f93 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082918 Jul 29 13:13:05.772025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 761/1495] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:05 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:06.792506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:06.793053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:06.800314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:06.800774 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:06.801577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:06.802058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:06.863219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:06.870682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a39078c9-d9db-4295-a955-ad45449269ae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082085 Jul 29 13:13:06.871246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 735/1496] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:06 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:07.891119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:07.891743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:07.898245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:07.898691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:07.899441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:07.899877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:07.962626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:07.970244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1090d52c-5049-4d8e-be5f-f7db95acdca1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082914 Jul 29 13:13:07.970799 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 762/1497] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:08.991584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:08.992208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:08.999037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:08.999521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:09.000339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:09.000827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:09.061326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:09.068990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9aae5082-33d2-4641-8e68-676e912f24d5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081255 Jul 29 13:13:09.069605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 736/1498] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:08 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:10.090346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:10.090941 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:10.098277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:10.098734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:10.099494 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:10.099937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:10.162119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:10.169560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e9248430-8364-41dd-9b10-fb63b3403ef1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083326 Jul 29 13:13:10.170157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 763/1499] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:10 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:11.190907 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:11.191464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:11.197492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:11.197980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:11.198749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:11.199191 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:11.263367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:11.270918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7bb4529a-88ac-4e89-a9e1-f6049f3915d4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084810 Jul 29 13:13:11.271488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 737/1500] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:11 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:12.292406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:12.293024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:12.299235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:12.299691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:12.300454 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:12.300894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:12.361591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:12.369372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8e98f32e-4822-42cf-b56b-de503b8ece96 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081028 Jul 29 13:13:12.369974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 764/1501] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:12 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:13.390571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:13.391182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:13.398301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:13.398756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:13.399540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:13.399985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:13.720623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:13.728142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-901cf66e-860b-4089-840a-8d2098181c2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.341402 Jul 29 13:13:13.728705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 738/1502] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:13 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:14.748602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:14.749321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:14.755922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:14.756377 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:14.757147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:14.757592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:14.818880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:14.826340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a0049f13-9bcb-421e-910a-f9807d9024ad tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081658 Jul 29 13:13:14.826910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 765/1503] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:14 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:15.848593 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:15.849209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:15.855782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:15.856238 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:15.857022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:15.857464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:15.920292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:15.927770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f72fa483-f2ef-41aa-ad3e-d98373763a6b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083565 Jul 29 13:13:15.928332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 739/1504] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:15 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:16.948136 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:16.948843 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:16.955334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:16.955779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:16.956529 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:16.956959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:17.020234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:17.027632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-929bda4b-48de-406f-ba6e-0c84e1ed76a3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083368 Jul 29 13:13:17.028191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 766/1505] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:16 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:18.048518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:18.049111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:18.055653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:18.056104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:18.056865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:18.057306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:18.117498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:18.125598 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9c906800-f4a6-4d7f-bbdd-d3eb96bf8e09 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080843 Jul 29 13:13:18.126911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 740/1506] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:18 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:19.146010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:19.146629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:19.153139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:19.153591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:19.154385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:19.154825 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:19.215341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:19.222833 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7a1f33e2-b9a5-425a-8800-93f9ff05aca6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080706 Jul 29 13:13:19.223388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 767/1507] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:19 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:20.245699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:20.246333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:20.253254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:20.253702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:20.254484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:20.254923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:20.315243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:20.322564 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14e7a5da-079d-4fad-9d2f-1cecd8eb9c53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081309 Jul 29 13:13:20.323149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 741/1508] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:20 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:13:21.344234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:21.344840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:21.351287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:21.351732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:21.352481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:21.352907 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:21.415038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:21.422926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7ed795aa-1c6a-4eb1-8ff9-291198dca982 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082075 Jul 29 13:13:21.423491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 768/1509] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:21 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:22.442773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:22.443315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:22.449879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:22.450339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:22.451107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:22.451554 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:22.513779 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:22.521853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e89369d3-631e-4ed5-9ff2-1ef9bf79fcf7 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082989 Jul 29 13:13:22.522424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 742/1510] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:22 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:23.543021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:23.543630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:23.550802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:23.551248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:23.551997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:23.552427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:23.614085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:23.621681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e9dd78e8-733b-4c4f-b3a7-9e5303f583a4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082568 Jul 29 13:13:23.622278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 769/1511] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:23 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:24.643271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:24.643932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:24.651278 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:24.651727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:24.652489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:24.652924 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:24.713058 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:24.721489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b15936cf-e262-475a-a872-3e888525e2da tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082217 Jul 29 13:13:24.722088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 743/1512] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:24 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:25.742045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:25.742642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:25.749270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:25.749720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:25.750517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:25.750960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:25.814485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:25.821977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5cc17637-f212-4b17-acae-c2ec628b8d06 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083831 Jul 29 13:13:25.822544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 770/1513] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:25 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:26.842609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:26.843293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:26.850387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:26.850851 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:26.851609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:26.852049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:26.855910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:26.912626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:26.920059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-26358cbd-943f-4c54-8be7-be978e5d094b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081362 Jul 29 13:13:26.920625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 744/1514] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:26 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:27.940605 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:27.941229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:27.947743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:27.948197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:27.948960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:27.949401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:27.951956 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:28.010531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:28.017930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b20298d8-cd98-4612-a91a-106d0b90e521 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081254 Jul 29 13:13:28.018503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 771/1515] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:27 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:29.038569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:29.039240 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:29.041502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:29.047151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:29.048115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:29.048883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:29.049327 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:29.112707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:29.120302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e4838c22-89ad-4901-9269-3e0c0ca64d41 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085560 Jul 29 13:13:29.120859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 745/1516] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:29 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:30.142126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:30.142742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:30.145058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:30.150414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:30.150865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:30.151622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:30.152058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:30.212639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:30.220182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a2335c1a-ac08-4e2a-8aee-4ed32f850627 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082632 Jul 29 13:13:30.220748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 772/1517] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:30 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:31.241673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:31.242243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:31.248870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:31.249325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:31.250131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:31.251305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:31.315510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:31.322976 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0a2118b3-bd16-4e41-a7b6-7a5386d12755 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085534 Jul 29 13:13:31.323541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 746/1518] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:31 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:32.343972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:32.344588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:32.351555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:32.352013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:32.352794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:32.353235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:32.419792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:32.427610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f36ff68a-7446-4f1b-91a9-9396651dd238 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087606 Jul 29 13:13:32.428183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 773/1519] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:32 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:33.448463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:33.449075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:33.455566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:33.456020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:33.456778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:33.457217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:33.517154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:33.524630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-83283c31-c146-4f36-9fb2-b18e62ff76df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079989 Jul 29 13:13:33.525196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 747/1520] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:33 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:34.545155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:34.545760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:34.552934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:34.553391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:34.554191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:34.554637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:34.620614 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:34.628794 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c81b6398-a126-4edb-90d5-4b9da76c75a6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087735 Jul 29 13:13:34.629358 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 774/1521] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:34 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:35.649584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:35.650341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:35.657576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:35.658061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:35.658824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:35.659261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:35.722411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:35.729810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3a58448b-1af7-4e24-a7ea-09b682551906 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083963 Jul 29 13:13:35.730405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 748/1522] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:35 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:36.750873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:36.751480 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:36.759456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:36.760141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:36.760923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:36.761364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:36.824982 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:36.833187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-494ec3b3-ff74-46e7-80cf-899a7dc7e3b8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086208 Jul 29 13:13:36.833754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 775/1523] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:36 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:37.854579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:37.855187 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:37.862645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:37.863101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:37.863866 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:37.864304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:37.925530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:37.933057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c53d32f2-3b60-4b2e-b11b-d824ba94164f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082328 Jul 29 13:13:37.933620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 749/1524] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:37 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:38.952906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:38.954107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:38.960504 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:38.960946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:38.961690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:38.962144 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:39.023107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:39.030475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-92b82f2a-193e-4b70-b209-c145ef4462ac tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081426 Jul 29 13:13:39.031027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 776/1525] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:38 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:40.051879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:40.052466 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:40.059539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:40.059989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:40.060746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:40.061213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:40.124864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:40.132628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-19732945-c24d-4b09-82d4-769f3aaa23e2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084568 Jul 29 13:13:40.133192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 750/1526] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:40 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:41.152640 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:41.153249 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:41.159839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:41.160296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:41.161062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:41.161501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:41.222968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:41.230608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-70a54d30-75f5-4151-83bc-1f10793ff1c0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081931 Jul 29 13:13:41.231175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 777/1527] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:41 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:42.252895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:42.253548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:42.259638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:42.260089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:42.260855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:42.261297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:42.321121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:42.328704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a18865e0-c1f2-4f6a-a459-7b307d11210a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080348 Jul 29 13:13:42.329267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 751/1528] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:42 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:43.349730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:43.350386 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:43.356465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:43.356915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:43.357682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:43.358154 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:43.420763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:43.428815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d5a78ecd-fa6c-4786-a8f5-92062bccfea2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083149 Jul 29 13:13:43.429385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 778/1529] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:43 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:44.451719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:44.452262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:44.458951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:44.459406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:44.460176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:44.460619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:44.526509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:44.534315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a0d3eec1-e8f4-4115-a3d7-d8d1a7caa422 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086468 Jul 29 13:13:44.534906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 752/1530] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:44 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:45.555841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:45.556459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:45.563138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:45.563582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:45.564366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:45.564798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:45.626515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:45.633977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7407a7d0-46eb-4776-84f5-1fe43c582584 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081936 Jul 29 13:13:45.634535 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 779/1531] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:45 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:46.654616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:46.655228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:46.662542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:46.662997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:46.663768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:46.664209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:46.726481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:46.733939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f3637b46-6381-452b-8991-b30366f1a256 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083165 Jul 29 13:13:46.734514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 753/1532] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:46 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:47.754677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:47.755297 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:47.762014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:47.762468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:47.763234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:47.763679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:47.828296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:47.835919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3d8e4c66-9a47-4c80-adb0-aa83da56eee6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085559 Jul 29 13:13:47.836486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 780/1533] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:47 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:48.857298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:48.857918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:48.865130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:48.865582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:48.866372 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:48.866814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:48.927156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:48.934692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e49a90a4-4b9e-4914-8213-1291ca3f162b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081323 Jul 29 13:13:48.935271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 754/1534] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:48 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:49.104407 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:13:49.104932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:13:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:13:49.956020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:49.956637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:49.963258 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:49.963714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:49.964477 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:49.964918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:50.025692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:50.033156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9537849d-1a58-4049-a4c8-74b35e158fd8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081693 Jul 29 13:13:50.033715 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 781/1535] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:49 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:51.054192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:51.054810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:51.061439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:51.061936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:51.062710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:51.063178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:51.123957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:51.131572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f8d14705-ec26-472f-b143-10b508f3e2bd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081368 Jul 29 13:13:51.132135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 755/1536] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:52.152599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:52.153140 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:52.160117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:52.160562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:52.161312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:52.161744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:52.226394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:52.233686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6d9020fd-4057-46f9-abfd-9ff763fe187d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085044 Jul 29 13:13:52.234266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 782/1537] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:52 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:53.255605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:53.256233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:53.262771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:53.263213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:53.263965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:53.264399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:53.327078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:53.334775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6055e90e-d167-409d-b11a-f9056dec2188 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083629 Jul 29 13:13:53.335337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 756/1538] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:53 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:54.355368 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:54.355999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:54.363132 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:54.363574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:54.364322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:54.364752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:54.425962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:54.433354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-be847575-a685-449b-b8c9-80ffd08ceb78 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081866 Jul 29 13:13:54.433926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 783/1539] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:54 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:55.454206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:55.454820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:55.461335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:55.461791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:55.462596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:55.463056 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:55.523317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:55.530821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-55162ec5-9f34-4399-8738-54a96e66516c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080534 Jul 29 13:13:55.531326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 757/1540] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:55 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:56.555001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:56.555001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:56.563090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:56.563552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:56.564319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:56.564758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:56.626962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:56.634492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-579756b0-5002-4d83-afe3-c009fafdd216 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087113 Jul 29 13:13:56.635051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 784/1541] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:57.654304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:57.654922 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:57.662225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:57.662711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:57.663481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:57.663926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:57.667836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:57.724635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:57.732151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1d681655-dbee-4c20-9994-ce71e308e8e8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081737 Jul 29 13:13:57.732729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 758/1542] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:58.752532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:58.753789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:58.760354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:58.760796 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:58.761540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:58.762006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:58.765824 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:58.822867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:58.830251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d8d1aec5-8650-41b7-8020-c833f79a1ba5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081608 Jul 29 13:13:58.830803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 785/1543] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:58 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:13:59.851516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:13:59.852134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:13:59.854483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:13:59.860210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:59.860662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:59.861434 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:13:59.861905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:13:59.925688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:13:59.933105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ff18b8cf-4941-4019-82ee-3f4a8f72351e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086169 Jul 29 13:13:59.933661 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 759/1544] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:13:59 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:00.953653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:00.954301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:00.956593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:14:00.962061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:00.962462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:00.963230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:00.963671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:01.026849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:01.034896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a7ba3c00-c389-49e0-b933-5a721754eb5f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084593 Jul 29 13:14:01.035492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 786/1545] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:02.056101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:02.056718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:02.063233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:02.063718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:02.064488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:02.064932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:02.130355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:02.137946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a5c6e0f7-aa2c-41b5-9739-6dc49bd4ba4b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085807 Jul 29 13:14:02.138552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 760/1546] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:03.159261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:03.159874 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:03.166447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:03.166896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:03.167656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:03.168094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:03.228228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:03.235702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-487bf52f-50e4-45b6-a4fe-404e86a3db1a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080314 Jul 29 13:14:03.236520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 787/1547] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:03 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:04.257423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:04.258088 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:04.264832 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:04.265312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:04.266149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:04.266596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:04.326442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:04.333951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d744ac2c-d6b8-410c-b940-91d0a7c71003 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080504 Jul 29 13:14:04.334516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 761/1548] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:04 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:05.355501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:05.356146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:05.362962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:05.363417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:05.364181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:05.364617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:05.428849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:05.436394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-50473ee9-d713-4aeb-a88a-5def325b75eb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084806 Jul 29 13:14:05.436954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 788/1549] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:05 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:06.457199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:06.457726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:06.464214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:06.464662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:06.465415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:06.465867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:06.526943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:06.534485 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-82236d68-9246-47c3-b4c6-207fe8a0bbc6 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081635 Jul 29 13:14:06.535089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 762/1550] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:06 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:07.555266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:07.555877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:07.562547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:07.563013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:07.563774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:07.564210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:07.623986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:07.632250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b2230983-3a92-4ffc-bf9e-e463c95c6849 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080818 Jul 29 13:14:07.632804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 789/1551] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:08.652471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:08.653082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:08.659710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:08.660170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:08.660937 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:08.661390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:08.727188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:08.734742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-11834c12-a66b-4859-b5e8-c417fbab0e56 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086133 Jul 29 13:14:08.735314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 763/1552] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:08 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:09.756229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:09.756819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:09.763290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:09.763740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:09.764498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:09.764934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:09.828221 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:09.835656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0166f2fc-aa6e-47e9-8342-75ddcc8d7b92 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083978 Jul 29 13:14:09.836207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 790/1553] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:09 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:10.856204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:10.856793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:10.863652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:10.864106 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:10.864859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:10.865299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:10.927415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:10.934856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-61095f99-1790-4a18-a49d-152172052d5c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082701 Jul 29 13:14:10.935410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 764/1554] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:10 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:11.955056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:11.955663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:11.961965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:11.962421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:11.963183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:11.963624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:12.023728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:12.031304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-df3bac1b-9b60-4ca0-8a0c-f4ffafef3611 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080144 Jul 29 13:14:12.031870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 791/1555] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:11 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:13.052104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:13.052756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:13.059359 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:13.059819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:13.060591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:13.061035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:13.121872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:13.129972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c238e20e-e3a7-4321-b043-4461e5eb4930 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081904 Jul 29 13:14:13.130533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 765/1556] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:13 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:14.150357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:14.150996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:14.157910 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:14.158366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:14.159815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:14.160253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:14.220064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:14.228101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b32242f0-5474-4cf6-83fa-f59b1e41d0db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081569 Jul 29 13:14:14.228662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 792/1557] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:14 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:15.249315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:15.249895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:15.257194 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:15.257659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:15.258474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:15.258919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:15.321491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:15.328855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f6c2bc0c-8d7a-4691-9b01-838528923867 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083612 Jul 29 13:14:15.329411 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 766/1558] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:15 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:16.350225 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:16.350839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:16.357630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:16.358116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:16.358883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:16.359321 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:16.419267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:16.427162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-28e8a03e-1db6-472b-838b-915a804e027d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080770 Jul 29 13:14:16.427725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 793/1559] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:16 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:14:17.448559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:17.449170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:17.455675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:17.456116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:17.456877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:17.457314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:17.518213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:17.525635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-40285793-afed-48f0-bd14-767cfc402f28 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080899 Jul 29 13:14:17.526236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 767/1560] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:17 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:18.546877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:18.547458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:18.554703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:18.555162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:18.555981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:18.556422 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:18.626994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:18.634928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-19fdf174-38da-4803-9a89-eb992a66d88b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.092026 Jul 29 13:14:18.635484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 794/1561] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:18 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:19.656397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:19.657005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:19.664200 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:19.664649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:19.665402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:19.665855 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:19.730658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:19.738439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-56291d9e-c206-4636-a3b7-b114d6535590 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085653 Jul 29 13:14:19.739059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 768/1562] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:19 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:20.759081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:20.759703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:20.766311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:20.767041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:20.767997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:20.768456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:20.833535 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:20.841077 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7ed8a571-6d55-4cd2-b4f7-fdd6a3df108c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085918 Jul 29 13:14:20.841641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 795/1563] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:20 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:21.862143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:21.863108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:21.869802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:21.870291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:21.871087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:21.871534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:21.933847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:21.941308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-149b66b6-eaca-498f-82a7-0529369c4642 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083094 Jul 29 13:14:21.942022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 769/1564] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:21 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:22.961759 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:22.962415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:22.968912 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:22.969394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:22.970182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:22.970625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:23.031678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:23.039630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c63ad846-41db-4191-8115-4dfa6165ed46 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081769 Jul 29 13:14:23.040195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 796/1565] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:22 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:24.060505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:24.061107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:24.067627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:24.068079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:24.068838 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:24.069271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:24.130151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:24.137699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e2b3b55e-7e8c-46ba-9e24-9f8c7ee52c5b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081099 Jul 29 13:14:24.138295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 770/1566] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:24 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:25.158878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:25.159425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:25.166556 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:25.167001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:25.167749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:25.168178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:25.229212 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:25.236582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bc55abc7-2ccc-463a-99f2-e82cf118304a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081758 Jul 29 13:14:25.237141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 797/1567] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:25 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:26.257417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:26.258064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:26.264578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:26.265037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:26.265804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:26.266274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:26.326340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:26.334343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-adc44ed4-3c08-4f39-9a3e-3d7a881e7dc5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080789 Jul 29 13:14:26.334908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 771/1568] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:26 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:27.355514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:27.356125 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:27.362666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:27.363391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:27.364149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:27.364585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:27.428902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:27.436439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f80fdcbd-9a68-4c6f-9d32-cc24ff15eedf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084827 Jul 29 13:14:27.436995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 798/1569] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:27 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:28.457156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:28.457708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:28.464214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:28.464666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:28.465429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:28.465896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:28.468423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:14:28.529449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:28.536923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ba3268e8-33c7-417e-87a7-37197e6c0bff tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083797 Jul 29 13:14:28.537483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 772/1570] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:28 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:29.557440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:29.558074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:29.564986 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:29.565429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:29.566348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:29.566779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:29.570718 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:14:29.628832 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:29.636274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e4b38901-f9fd-49e6-80a3-afd8b2b86719 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082687 Jul 29 13:14:29.636840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 799/1571] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:29 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:30.656932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:30.657543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:30.659950 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:14:30.665169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:30.665616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:30.666408 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:30.666844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:30.729878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:30.737405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c08420ad-d413-442f-b862-a7bd44a605f0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084367 Jul 29 13:14:30.738748 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 773/1572] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:30 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:31.759075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:31.759706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:31.762033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:14:31.767366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:31.767819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:31.768592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:31.769651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:31.829148 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:31.837155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-837f5b58-474b-4bca-8ddf-e04ed0e4052a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081944 Jul 29 13:14:31.837748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 800/1573] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:31 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:32.857914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:32.858551 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:32.866107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:32.866497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:32.867258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:32.867697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:32.933173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:32.940715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1b601b38-9072-4292-ad97-b43683166bfd tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086620 Jul 29 13:14:32.941308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 774/1574] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:32 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:33.960962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:33.961568 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:33.968315 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:33.968771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:33.969574 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:33.970069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:34.031508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:34.039428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-186ddb65-ecbc-4796-b673-016d9dac1de0 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082882 Jul 29 13:14:34.039988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 801/1575] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:33 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:35.060724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:35.061362 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:35.068405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:35.068868 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:35.069639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:35.070103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:35.132050 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:35.139474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1fe36dea-7e02-45ac-8c1d-55f43a34f74c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082621 Jul 29 13:14:35.140040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 775/1576] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:35 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:36.160094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:36.160709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:36.167228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:36.167675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:36.168429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:36.168866 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:36.234780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:36.242971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-545a5c41-b13f-426a-bab0-77696f25cf53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086736 Jul 29 13:14:36.243538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 802/1577] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:36 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:37.264258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:37.264813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:37.271297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:37.271737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:37.272505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:37.272947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:37.343133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:37.353906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c874d72d-e36d-4924-892c-4e5bc794635a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.093486 Jul 29 13:14:37.354482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 776/1578] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:37 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:38.375822 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:38.376440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:38.385255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:38.385709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:38.388505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:38.388963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:38.453284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:38.460798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f6f90d3f-1ee7-4a38-914c-e8cb60c5f4cf tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.088802 Jul 29 13:14:38.461367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 803/1579] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:38 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:39.481701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:39.482348 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:39.489656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:39.490140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:39.490911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:39.491351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:39.552703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:39.560143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a93b6a33-c670-48f5-b0a2-4f6b3353fddb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082343 Jul 29 13:14:39.560713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 777/1580] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:39 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:40.579639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:40.580296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:40.586774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:40.587224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:40.587978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:40.588419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:40.648523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:40.655917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-89f8fad5-2100-4a26-8b89-b276666642a2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080078 Jul 29 13:14:40.656483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 804/1581] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:40 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:41.676798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:41.678004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:41.684095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:41.684546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:41.685303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:41.685740 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:41.746707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:41.754137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4f95a6a0-44d2-4609-804c-d749398225ef tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082054 Jul 29 13:14:41.754707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 778/1582] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:41 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:42.775021 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:42.775664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:42.781783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:42.782271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:42.783033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:42.783482 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:42.843531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:42.850939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-98c3df3d-b744-4ceb-b82c-eae5f834a0c4 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079991 Jul 29 13:14:42.851497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 805/1583] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:42 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:43.871734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:43.872329 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:43.879396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:43.879848 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:43.880613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:43.881055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:43.945098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:43.952548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f7a134fd-2a29-4758-bfcf-9fdcad308e95 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084655 Jul 29 13:14:43.953115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 779/1584] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:43 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:44.974163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:44.974776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:44.981401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:44.981877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:44.982642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:44.983078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:45.049036 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:45.056722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9e0a5579-9bbf-4689-b660-9fff070d0304 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087054 Jul 29 13:14:45.057286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 806/1585] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:44 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:46.077637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:46.078259 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:46.085207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:46.085652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:46.086437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:46.086877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:46.149522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:46.157099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-454b2d19-982b-43dc-ab19-eb0419ce8d70 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083268 Jul 29 13:14:46.157674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 780/1586] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:46 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:47.178287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:47.178890 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:47.185352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:47.185797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:47.186572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:47.187001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:47.248375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:47.255759 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6d426511-7212-42b9-9d56-cd88ba368564 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081343 Jul 29 13:14:47.256306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 807/1587] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:47 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:48.276916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:48.277558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:48.284626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:48.285080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:48.285864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:48.286462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:48.347799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:48.355218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-efd717f3-07a5-4d54-b5a9-5ff8bf78e163 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082263 Jul 29 13:14:48.355914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 781/1588] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:48 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:49.376278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:49.376849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:49.383900 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:49.384349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:49.385105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:49.385538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:49.445512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:49.452889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-94aa0458-e3fe-4065-ba06-3c0997727fbc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080536 Jul 29 13:14:49.453446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 808/1589] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:49 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:50.474682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:50.475233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:50.481608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:50.482083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:50.482835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:50.483267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:50.677224 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:50.684954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8a2e4db0-b94b-4898-abcd-f914d76ee268 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.214830 Jul 29 13:14:50.685519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 782/1590] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:51.706651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:51.707345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:51.713993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:51.714465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:51.715219 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:51.715663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:51.821369 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:51.829216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-13386646-cd69-4df1-9390-c73b9e38acfb tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.126984 Jul 29 13:14:51.829786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 809/1591] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:51 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:52.850812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:52.851431 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:52.858065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:52.858523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:52.859293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:52.859738 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:52.922729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:52.930986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0c5527be-f57b-4296-bbef-ffca3c3cd95d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084519 Jul 29 13:14:52.931553 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 783/1592] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:52 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:53.951202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:53.951817 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:53.958886 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:53.959337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:53.960098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:53.960536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:54.024579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:54.032164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6007b7f4-37e4-4c5a-8612-2de534c3a5b9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084831 Jul 29 13:14:54.032725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 810/1593] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:53 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:55.056675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:55.057290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:55.064024 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:55.064481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:55.065285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:55.065731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:55.132829 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:55.140339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-229494dc-4988-4cca-861d-bad614dc6065 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087533 Jul 29 13:14:55.140897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 784/1594] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:55 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:56.161693 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:56.162327 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:56.168767 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:56.169213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:56.169997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:56.170436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:56.230346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:56.237786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-918f57ce-5865-48e1-a7ba-4ded2ea0f50d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080653 Jul 29 13:14:56.238631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 811/1595] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:56 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:57.259583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:57.260122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:57.266791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:57.267253 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:57.268021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:57.269067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:57.331201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:57.338638 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-18079cda-3c42-422f-84c5-c8e68c7619df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083055 Jul 29 13:14:57.339197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 785/1596] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:57 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:58.359565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:58.360201 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:58.367496 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:58.367944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:58.368701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:58.369137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:58.429094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:58.437485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a3167191-6c5c-4f37-85ad-253266b8fc2b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081723 Jul 29 13:14:58.438100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 812/1597] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:58 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:14:59.459549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:14:59.460178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:14:59.466870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:59.467374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:59.468100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:14:59.468552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:14:59.471184 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:14:59.533530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:14:59.540978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6092483d-1385-461c-9276-03cade5b834d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085918 Jul 29 13:14:59.541539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 786/1598] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:14:59 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:00.561776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:00.562414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:00.568940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:00.569392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:00.570180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:00.570619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:00.574598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:00.631568 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:00.639067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6d8975cf-15b2-4ffd-aaae-f28ac906696f tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081189 Jul 29 13:15:00.639621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 813/1599] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:00 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:01.659995 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:01.660601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:01.662871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:01.668091 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:01.668536 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:01.669287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:01.669722 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:01.732145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:01.740238 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ff679d57-3e8d-428b-85db-e26e5d1fcf27 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084060 Jul 29 13:15:01.740791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 787/1600] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:01 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:02.761839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:02.762448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:02.764871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:02.770180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:02.770628 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:02.771382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:02.771814 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:02.834820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:02.842291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cd4d003c-e336-4f15-8db7-b10c8aa7f8db tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084397 Jul 29 13:15:02.842842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 814/1601] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:02 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:03.864014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:03.864652 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:03.871420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:03.871873 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:03.872640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:03.873083 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:03.933691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:03.941529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-83a9b03e-0375-484a-a4a9-a3fa1443ebf8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081967 Jul 29 13:15:03.942158 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 788/1602] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:03 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:04.962363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:04.962920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:04.969374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:04.969848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:04.970615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:04.971534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:05.033355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:05.041271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9f01abc8-e626-45ed-be59-9e93faabc709 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082896 Jul 29 13:15:05.041844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 815/1603] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:04 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:06.062618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:06.063228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:06.069695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:06.070188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:06.070949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:06.071395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:06.132174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:06.139667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bad6094a-f17e-4cf8-8c21-bf346f912004 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080958 Jul 29 13:15:06.140228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 789/1604] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:06 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:07.160632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:07.161246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:07.167870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:07.168322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:07.169115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:07.169554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:07.231918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:07.239829 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b3d86483-f115-4e81-81cb-6a255a0bb45b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083025 Jul 29 13:15:07.240437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 816/1605] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:07 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:08.261675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:08.262298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:08.269267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:08.269721 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:08.270519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:08.270957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:08.329952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:08.337934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-33e7f45e-791c-4fb8-b125-882af640ffb2 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080061 Jul 29 13:15:08.338493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 790/1606] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:08 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:08.646476 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:15:08.646711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:15:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:15:09.359126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:09.359749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:09.367286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:09.367741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:09.368506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:09.368949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:09.430203 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:09.437562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-81a471e7-b1ed-4f7b-96b7-dc1b52818cae tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082314 Jul 29 13:15:09.438163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 817/1607] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:09 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:10.458267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:10.458807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:10.465065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:10.465524 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:10.466322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:10.466767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:10.531016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:10.539716 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b07f93ab-1c96-48c5-973e-bcfb01747f25 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085387 Jul 29 13:15:10.540279 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 791/1608] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:10 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:11.560780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:11.561391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:11.567458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:11.567917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:11.568700 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:11.569142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:11.632066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:11.639612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-510254e2-de4e-4005-ad6e-ee50605c90f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082820 Jul 29 13:15:11.640187 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 818/1609] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:11 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:12.660375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:12.660988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:12.667481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:12.667936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:12.668699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:12.669143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:12.729494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:12.737484 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-20083309-5ebe-4182-a29d-47d0dc752b23 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080968 Jul 29 13:15:12.738137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 792/1610] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:12 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:13.758857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:13.759491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:13.766139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:13.766591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:13.767356 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:13.768449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:13.828696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:13.837033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4fa65b35-b2ce-40b3-8e33-47e197770c6e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082057 Jul 29 13:15:13.837601 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 819/1611] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:13 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:14.857534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:14.858171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:14.865696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:14.866181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:14.866943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:14.867649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:14.936965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:14.944617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e2315722-1ea2-4981-9663-def74cab4f83 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.090934 Jul 29 13:15:14.945182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 793/1612] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:14 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:15.965631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:15.966324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:15.972806 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:15.973262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:15.974058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:15.974499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:16.035349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:16.042739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f92bea8a-afb0-4959-a126-5f776d316119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081075 Jul 29 13:15:16.043300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 820/1613] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:15 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:17.063984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:17.064620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:17.071117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:17.071574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:17.072339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:17.072782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:17.134410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:17.141914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ea26fa47-bd20-433b-bf09-e5358eb5d128 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081713 Jul 29 13:15:17.142481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 794/1614] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:17 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:18.162791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:18.163438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:18.170045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:18.170503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:18.171270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:18.171713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:18.232962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:18.240946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8544e9f4-a758-48b7-9e7d-ee3d1f02cf4e tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082753 Jul 29 13:15:18.241517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 821/1615] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:18 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:19.263805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:19.264389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:19.272109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:19.272569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:19.273345 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:19.273787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:19.342198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:19.349689 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bd500861-3cd6-4ca7-ab53-3c27309398df tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.090179 Jul 29 13:15:19.350286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 795/1616] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:19 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:20.370531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:20.371172 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:20.378380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:20.378776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:20.379534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:20.379971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:20.445200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:20.452729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-80a6099b-5eac-471e-b394-94de6bb7e27a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085967 Jul 29 13:15:20.453290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 822/1617] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:20 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:21.474190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:21.474801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:21.481288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:21.481743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:21.482538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:21.482980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:21.542894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:21.550928 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cda20c83-7a97-4042-96bb-1183ffab3447 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082211 Jul 29 13:15:21.551498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 796/1618] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:21 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:22.571531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:22.572152 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:22.578698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:22.579149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:22.579906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:22.580341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:22.640028 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:22.647463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7979ef9e-1d29-4d12-9baa-81124562c341 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079763 Jul 29 13:15:22.648027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 823/1619] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:22 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:23.668555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:23.669159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:23.675657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:23.676117 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:23.676880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:23.677325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:23.738136 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:23.745938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5ab2cf56-6555-43c2-a306-4278008459cc tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081253 Jul 29 13:15:23.746503 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 797/1620] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:23 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:24.767963 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:24.768586 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:24.775235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:24.775688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:24.776448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:24.776887 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:24.837512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:24.844799 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2609f73e-e760-42c3-93e8-67a761315887 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081287 Jul 29 13:15:24.845359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 824/1621] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:24 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:25.866849 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:25.867450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:25.874132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:25.874591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:25.875356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:25.875799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:25.935858 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:25.943252 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f6550c05-467e-4202-aaa9-5a1a88c31888 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080529 Jul 29 13:15:25.943811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 798/1622] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:25 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:26.963641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:26.964277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:26.971395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:26.971845 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:26.972608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:26.973046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:27.034447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:27.041881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f7701d46-f6b1-4ae5-88f4-55475f089497 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082135 Jul 29 13:15:27.042442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 825/1623] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:26 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:28.063248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:28.063860 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:28.070853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:28.071386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:28.072160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:28.072603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:28.138979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:28.147242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e1ecb173-d0fc-4ab5-b9a2-0566a99c2dda tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.087849 Jul 29 13:15:28.147810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 799/1624] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:28 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:28.154554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:15:28.155027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:15:29.167747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:29.168382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:29.174889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:29.175331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:29.176113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:29.176544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:29.240032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:29.247472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-385db1d5-f5a3-44f3-a378-07e85986b49a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083631 Jul 29 13:15:29.248023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 826/1625] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:29 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:15:30.267771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:30.268381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:30.275369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:30.275822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:30.276649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:30.277125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:30.281414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=84 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:30.340728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:30.348946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c846d665-14a6-4fc6-a0a4-a0b33957b8ab tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084998 Jul 29 13:15:30.349512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 800/1626] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:30 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:31.371083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:31.371703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:31.378615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:31.379070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:31.379838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:31.380279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:31.382870 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:31.444851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:31.452350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-778e6c48-1a5e-46b0-af78-2e15742acb53 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085120 Jul 29 13:15:31.452919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 827/1627] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:31 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:31.511025 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:15:31.511482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:15:32.473704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:32.474273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:32.476582 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=28 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:32.482127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:32.482584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:32.483353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:32.483799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:32.544669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:32.552784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e0e3f852-b1f2-4daa-99d5-de02390364f3 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083544 Jul 29 13:15:32.553350 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 801/1628] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:32 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:33.574334 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:33.574957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:33.577345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=28 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:15:33.583653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:33.584107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:33.584875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:33.585319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:33.646363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:33.654133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c2858fe2-e0a9-46b7-8227-7f76270d1119 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083607 Jul 29 13:15:33.654708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 828/1629] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:33 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:34.674913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:34.675612 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:34.682455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:34.682909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:34.683710 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:34.684153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:34.754999 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:34.762654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3d562380-2d2f-4a2d-bc6a-cf5f7bbc2500 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.091587 Jul 29 13:15:34.763219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 802/1630] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:34 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:35.785093 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:35.785697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:35.792278 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:35.792729 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:35.793485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:35.793948 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:35.857985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:35.866442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-32250af9-4132-47da-a715-5cb15131e33c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086086 Jul 29 13:15:35.867005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 829/1631] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:35 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:36.887089 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:36.887696 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:36.894226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:36.894677 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:36.895426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:36.895861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:36.958342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:36.965665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-193d3566-9421-49df-9b90-2bcd4ce572ea tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.082381 Jul 29 13:15:36.966257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 803/1632] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:36 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:37.986689 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:37.987382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:37.994017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:37.994464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:37.995216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:37.995644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:38.060357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:38.068439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-35b07d80-a877-472f-85c4-0f539d423c0b tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.085596 Jul 29 13:15:38.069015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 830/1633] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:37 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:39.091176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:39.092097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:39.102592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:39.103382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:39.104701 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:39.105459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:39.170312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:39.177718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3cf8f225-cf99-4abe-b6d6-758c01bbfa7d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.092756 Jul 29 13:15:39.178319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 804/1634] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:39 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:40.198503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:40.199119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:40.206258 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:40.206716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:40.207484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:40.207925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:40.268652 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:40.276033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6bdbd191-2ccc-4fe0-80cd-243eb029e045 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081436 Jul 29 13:15:40.276600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 831/1635] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:40 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:41.296655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:41.297757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:41.303959 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:41.304413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:41.305175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:41.305614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:41.365537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:41.373372 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5f2cbd0f-6700-40d0-9d72-d62c2a516ae8 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080736 Jul 29 13:15:41.373964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 805/1636] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:41 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:42.394290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:42.394809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:42.400816 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:42.401266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:42.402059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:42.402497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:42.462387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:42.469726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bf29eab1-ada1-4612-8ab8-9b085274bab5 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.079524 Jul 29 13:15:42.470316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 832/1637] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:42 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:43.490326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:43.490939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:43.497475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:43.497963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:43.498720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:43.499151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:43.567374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:43.574907 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1a900237-f394-4fbf-adb3-ee5f1d54bbe9 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.088672 Jul 29 13:15:43.575469 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 806/1638] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:43 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:43.621928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:15:43.622409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:15:44.596586 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:44.597197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:44.604428 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:44.604880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:44.605650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:44.606127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:44.668241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:44.676254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b5b8739-3ac8-49c5-8317-fa14c186863c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.084124 Jul 29 13:15:44.676819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 833/1639] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:44 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:45.696636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:45.697262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:45.704135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:45.704605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:45.705905 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:45.706357 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:45.765768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:45.774292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a004cf6f-a8e1-4d87-a4d3-5f829a332573 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.081521 Jul 29 13:15:45.774870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 807/1640] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:45 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:46.795283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:46.795925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:46.803238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:46.803688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:46.804479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:46.804915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:46.867987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:46.875410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7f10d465-c89c-4a85-82ac-8d1f63649e2a tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.083977 Jul 29 13:15:46.875972 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 834/1641] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:46 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:47.896540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:47.897146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:47.903673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:47.904121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:47.904872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:47.905307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:47.964735 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:47.973065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b197f90c-fb98-43e2-bb33-410a54a8b504 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080938 Jul 29 13:15:47.973620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 808/1642] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:47 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:48.993459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:48.994098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:49.000542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:49.000985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:49.001741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:49.002199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:49.061957 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:49.069763 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-14d6afba-67ab-43e7-92e5-b441a64cee0d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.080256 Jul 29 13:15:49.070350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 835/1643] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:48 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:50.090904 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:50.091799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: b362a80f-715f-4c80-8dae-26d950ffc42a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:50.098339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:50.098790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:50.099551 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:50.099991 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:50.165785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07220936c8784339b62f22482264e234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f411d81f95464389c9ea3c12cee88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:15:50.173365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4df33ea6-81a4-462b-a92c-e4c4d411d331 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a" status: 200 len: 1223 microversion: 2.1 time: 0.086301 Jul 29 13:15:50.174451 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 809/1644] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:50 2022] GET /compute/v2.1/servers/b362a80f-715f-4c80-8dae-26d950ffc42a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:15:50.647640 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:50.648173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:50.654935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:50.655391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:50.656157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:50.656598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:50.671883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] HTTP exception thrown: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Request method failure captured: Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: DELETE /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 HTTP/1.1 Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49f894tvKSHihyCeOq_KQBrslE1ACweZOlyaaQCoo4XP8PQhViDhHeD6mza-k5mc92D1pZGPT4gUATH7fHWLGw_89id3vT1bDsK4QcXruYvn-b1XIr2iD1m5jEwt0T4X0rNpDs1HkdEH_UjcP4xaNCPfnaumFJvCayPCa2VbMdq3zJY Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 15f411d81f95464389c9ea3c12cee88d Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-TestVolumeBootPattern-1639178603 Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 13:15:50.673513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-TestVolumeBootPattern-1639178603 Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 15f411d81f95464389c9ea3c12cee88d Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-TestVolumeBootPattern-1639178603 Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-TestVolumeBootPattern-1639178603-project Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 07220936c8784339b62f22482264e234 Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-TestVolumeBootPattern-1639178603-project Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.675390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '0e77e87a-7f63-4eb0-9357-1e907bb5cf68'} Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:15:50.676353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.678120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.680051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Returning 404 to user: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:15:50.680051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a0b64fe7-7f96-4bc7-89e9-f1a3ed07985d tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 404 len: 111 microversion: 2.1 time: 0.031742 Jul 29 13:15:50.680051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 836/1645] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:15:50 2022] DELETE /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:15:50.683371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:15:50.683985 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] [instance: 0e77e87a-7f63-4eb0-9357-1e907bb5cf68] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:15:50.690614 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:50.691064 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:50.691823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:15:50.692264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:15:50.705889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] HTTP exception thrown: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Request method failure captured: Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 HTTP/1.1 Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49f894tvKSHihyCeOq_KQBrslE1ACweZOlyaaQCoo4XP8PQhViDhHeD6mza-k5mc92D1pZGPT4gUATH7fHWLGw_89id3vT1bDsK4QcXruYvn-b1XIr2iD1m5jEwt0T4X0rNpDs1HkdEH_UjcP4xaNCPfnaumFJvCayPCa2VbMdq3zJY Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 15f411d81f95464389c9ea3c12cee88d Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-TestVolumeBootPattern-1639178603 Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 13:15:50.707489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/15f411d81f95464389c9ea3c12cee88d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-TestVolumeBootPattern-1639178603 Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 15f411d81f95464389c9ea3c12cee88d Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-TestVolumeBootPattern-1639178603 Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-TestVolumeBootPattern-1639178603-project Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 07220936c8784339b62f22482264e234 Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-TestVolumeBootPattern-1639178603-project Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.710020 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '0e77e87a-7f63-4eb0-9357-1e907bb5cf68'} Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:15:50.711574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. Jul 29 13:15:50.713646 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:15:50.716263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Returning 404 to user: Instance 0e77e87a-7f63-4eb0-9357-1e907bb5cf68 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:15:50.716263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cf56f3e1-cc1a-405a-8701-a6cf1000a17c tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68" status: 404 len: 111 microversion: 2.1 time: 0.029313 Jul 29 13:15:50.716263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 810/1646] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:15:50 2022] GET /compute/v2.1/servers/0e77e87a-7f63-4eb0-9357-1e907bb5cf68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:15:53.295150 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:15:53.295765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:17:09.115588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:17:09.116118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:17:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:17:52.672560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:52.675046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:52.677862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR oslo.messaging._drivers.impl_rabbit [-] [352bdc36-01b7-488f-81fb-dca14cfc664d] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 13:17:52.678381 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=17 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:17:52.679142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=55 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:17:52.685186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:52.685637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:52.686437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:52.686871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:52.718300 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f9a2fb18-e33e-43e5-8d19-efa89b4bd28f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053391 Jul 29 13:17:52.723059 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 837/1647] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:17:53.729534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76004ffb-65f1-4920-bae8-fe0ef9fac084] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 13:17:53.730599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=19 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:17:53.731333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=61 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:17:53.735665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:53.737835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:53.744806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:53.745262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:53.746107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:53.746552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:53.776340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-894d3bf5-1192-41c2-8d67-c6c218274637 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049052 Jul 29 13:17:53.776934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 811/1648] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:17:54.788747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:54.790983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:54.799163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:54.799619 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:54.800430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:54.800875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:54.805881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] [352bdc36-01b7-488f-81fb-dca14cfc664d] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 36094. Jul 29 13:17:54.832937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-90dd2197-ff73-4f08-abb3-e10d1b760928 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048238 Jul 29 13:17:54.833503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 838/1649] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:17:55.846028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:55.848478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:55.857685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:55.858203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:55.859101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:55.859552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:55.865518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] [76004ffb-65f1-4920-bae8-fe0ef9fac084] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 36098. Jul 29 13:17:55.891300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a4a3acdc-6ba3-4873-b516-c14fd6868558 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049852 Jul 29 13:17:55.891865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 812/1650] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:17:56.903687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:56.905946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:56.912380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:56.912836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:56.913597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:56.914067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:56.942554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d5440026-3b2e-4f20-acce-68376d53fac1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042868 Jul 29 13:17:56.943098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 839/1651] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:17:57.955008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:57.957176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:57.963633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:57.964085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:57.964859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:57.965302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:57.995047 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-53e50a99-3ca2-44b3-84a2-7d2e8770dc12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044062 Jul 29 13:17:57.995588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 813/1652] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:17:59.007328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:17:59.009542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:17:59.016349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:59.016851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:59.017618 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:17:59.018090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:17:59.047366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f40497fd-e86c-4b3f-b209-b71189680de8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044092 Jul 29 13:17:59.047919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 840/1653] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:17:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:00.060771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:00.063234 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:00.070224 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:00.070730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:00.071547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:00.072039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:00.104687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-14a5db03-bd2a-4b5a-829d-d4bc140ccf93 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048635 Jul 29 13:18:00.105236 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 814/1654] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:01.116935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:01.119126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:01.125831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:01.126299 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:01.127069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:01.127512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:01.157425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7c55d8fa-abdd-49d0-b375-2367e25cf6dd tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044755 Jul 29 13:18:01.158014 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 841/1655] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:02.170301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:02.172513 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:02.179309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:02.179769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:02.180733 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:02.181180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:02.211835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ac6dfecf-95e6-4bf9-91e7-4af8edea6eda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045347 Jul 29 13:18:02.211835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 815/1656] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:03.223757 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:03.226062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:03.233402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:03.233967 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:03.234738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:03.235178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:03.265953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a2ea1758-f83e-41c3-84df-992600ad9b28 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046284 Jul 29 13:18:03.266540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 842/1657] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:04.278428 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:04.281211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:04.287689 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:04.288135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:04.288886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:04.289319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:04.317531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-21956951-4962-4414-99ff-3cc7f366cb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043021 Jul 29 13:18:04.318097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 816/1658] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:05.330035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:05.332226 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:05.338718 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:05.339173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:05.339961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:05.340402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:05.370582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0d259a51-de71-40f6-a14e-b52bae9e6f38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044611 Jul 29 13:18:05.371127 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 843/1659] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:06.382903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:06.384960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:06.391435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:06.391891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:06.392656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:06.393098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:06.422054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c8d27c51-128d-4966-9114-17d161fe602d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043133 Jul 29 13:18:06.422609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 817/1660] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:07.434246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:07.436884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:07.443319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:07.443765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:07.444524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:07.444959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:07.474057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-109e65d7-7ae8-4e2d-9208-a6bbabd9c7a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044060 Jul 29 13:18:07.474597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 844/1661] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:08.487062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:08.489096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:08.495768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:08.496216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:08.496967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:08.497397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:08.526131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-adc362f7-0cc1-48ae-abfd-077714fd5672 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043573 Jul 29 13:18:08.526665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 818/1662] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:09.538829 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:09.541074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:09.547800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:09.548285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:09.549055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:09.549534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:09.580149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-769b049b-ebe6-4673-81ee-ce01137f659d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045261 Jul 29 13:18:09.580758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 845/1663] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:10.593065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:10.595791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:10.602470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:10.602925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:10.603732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:10.604175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:10.634891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b62aa712-88e8-4608-874f-83c25130273e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045906 Jul 29 13:18:10.635515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 819/1664] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:11.647586 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:11.649718 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:11.656749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:11.657236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:11.658038 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:11.658528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:11.687862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4a2c9dd5-de41-4c63-b254-ca1d299afb12 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044333 Jul 29 13:18:11.688415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 846/1665] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:12.699880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:12.702066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:12.708569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:12.709019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:12.709783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:12.710249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:12.739852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dabb02eb-f38c-450e-9075-bc8839cea896 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043918 Jul 29 13:18:12.740660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 820/1666] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:13.753284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:13.755489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:13.762171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:13.762629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:13.763393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:13.763834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:13.793485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b9c53551-1bbe-4eb7-b467-71dbd4e81e65 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044897 Jul 29 13:18:13.794078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 847/1667] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:14.805773 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:14.807942 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:14.816036 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:14.816487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:14.817245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:14.817683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:14.847947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4e859555-744f-43f9-9d82-267d241d224e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045831 Jul 29 13:18:14.848296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 821/1668] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:15.860737 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:15.862927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:15.869687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:15.870176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:15.870946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:15.871387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:15.899976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6da6efec-a972-4386-acd4-1bf793a44696 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043816 Jul 29 13:18:15.900518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 848/1669] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:16.912220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:16.914401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:16.920822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:16.921275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:16.922076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:16.923012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:16.952037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cd6a18ba-73b6-402f-be86-bef616e05ede tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043829 Jul 29 13:18:16.952611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 822/1670] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:17.964492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:17.966692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:17.973727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:17.974204 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:17.975053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:17.975495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:18.005773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a3811ec8-a5cd-45fe-8e59-e49a7cba5a85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045252 Jul 29 13:18:18.006355 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 849/1671] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:19.018592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:19.020767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:19.027554 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:19.028049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:19.028807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:19.029241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:19.058265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-81915281-f6de-4376-9009-0f014b4cb86d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044087 Jul 29 13:18:19.059526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 823/1672] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:20.071032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:20.073192 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:20.079637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:20.080083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:20.080839 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:20.081268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:20.111271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-09039d13-0a78-46e1-8a42-afbcd2575987 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044638 Jul 29 13:18:20.111835 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 850/1673] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:21.124055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:21.126265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:21.132865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:21.133322 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:21.134183 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:21.134625 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:21.165293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4dff2ce5-7f49-4d2f-9727-9743a05c4203 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045321 Jul 29 13:18:21.165865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 824/1674] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:22.179232 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:22.181503 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:22.188280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:22.188731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:22.189659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:22.190121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:22.220135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f7479eb1-a48f-4fae-a044-35289a4b5d2a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045572 Jul 29 13:18:22.220686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 851/1675] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:23.233412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:23.235624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:23.242382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:23.242839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:23.243609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:23.244054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:23.273541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ef783b59-e81e-4b9c-a2c8-bf10e7eca399 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044450 Jul 29 13:18:23.274123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 825/1676] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:24.286421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:24.288608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:24.291042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=31 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:24.296425 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:24.296883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:24.297658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:24.298130 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:24.300644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=91 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:24.330085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b0fd418-5327-449b-8710-8f5b9ee6dea0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048099 Jul 29 13:18:24.330685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 852/1677] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:25.342481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:25.344543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:25.346972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=31 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:25.353022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:25.353474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:25.354258 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:25.354698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:25.357039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=91 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:25.385563 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6a3f7d66-a11f-4e86-ad03-224447916a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047191 Jul 29 13:18:25.386156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 826/1678] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:26.398281 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:26.400363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:26.406384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:26.406837 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:26.407598 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:26.408034 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:26.436913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-05948e2e-7ce9-47b1-9a8f-19fdde1af085 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042989 Jul 29 13:18:26.437456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 853/1679] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:27.449014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:27.451488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:27.458206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:27.458665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:27.459435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:27.459877 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:27.488812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7c7690bb-c304-4dcf-be9b-793c6e5b6703 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043887 Jul 29 13:18:27.489382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 827/1680] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:28.501526 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:28.503649 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:28.510293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:28.510753 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:28.511520 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:28.511964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:28.541237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-81436e59-fdf7-4932-a1a2-3f340af0de04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043780 Jul 29 13:18:28.541795 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 854/1681] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:28.654220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:18:28.654785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:18:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:18:29.554278 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:29.556376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:29.562990 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:29.563447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:29.564216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:29.564656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:29.595033 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0db4852b-c9ea-419c-aa93-529dee02b806 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045355 Jul 29 13:18:29.595594 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 828/1682] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:30.607350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:30.609483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:30.616214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:30.616662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:30.617416 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:30.617877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:30.647476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3feb84f0-fc29-40fc-9eaf-6693236624d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044117 Jul 29 13:18:30.648020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 855/1683] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:31.660320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:31.662471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:31.668819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:31.669266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:31.670061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:31.670861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:31.700426 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7287f72c-4f3b-4109-9d62-f5a4503a2228 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044026 Jul 29 13:18:31.700947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 829/1684] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:32.712819 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:32.714990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:32.721436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:32.721921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:32.722682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:32.723633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:32.752898 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c01f03bb-084e-4458-b96b-137de8c49662 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044184 Jul 29 13:18:32.753441 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 856/1685] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:33.764763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:33.766915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:33.774016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:33.774477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:33.775242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:33.775682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:33.805180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-42166d48-e135-4edc-802a-537cb73a8340 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044386 Jul 29 13:18:33.805732 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 830/1686] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:34.816817 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:34.819643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:34.826234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:34.826688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:34.827456 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:34.827893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:34.856405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e2c37c01-d013-49f1-9f60-9efaeaad5a81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043698 Jul 29 13:18:34.856950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 857/1687] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:35.869547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:35.871726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:35.878299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:35.878756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:35.879575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:35.880017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:35.908416 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e590d665-ade4-44bb-a440-b3a0e832b60a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043089 Jul 29 13:18:35.908969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 831/1688] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:36.921035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:36.923248 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:36.929742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:36.930227 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:36.930989 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:36.931429 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:36.960539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-17602121-585e-47da-9f2f-52bd7d182f64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043445 Jul 29 13:18:36.961083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 858/1689] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:18:37.972101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:37.974822 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:37.981269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:37.981725 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:37.982525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:37.982965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:38.012815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-93d50b6b-bbb9-4cb0-838c-5f3105c90636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044728 Jul 29 13:18:38.013369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 832/1690] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:39.025579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:39.027664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:39.034178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:39.034630 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:39.035394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:39.036340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:39.066533 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d232e7c5-2610-4e7a-9765-416521e3c56b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045013 Jul 29 13:18:39.067085 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 859/1691] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:40.078102 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:40.080218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:40.086730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:40.087182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:40.087948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:40.088686 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:40.122167 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6e4cb920-a9d8-43ee-89b7-7760c1b700e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048211 Jul 29 13:18:40.122727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 833/1692] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:41.134768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:41.136988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:41.143497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:41.143983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:41.144704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:41.145741 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:41.184459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3e7e2e10-0edf-4f70-83dd-4fe32e1c8f6a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053579 Jul 29 13:18:41.185092 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 860/1693] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:42.197351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:42.199764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:42.207997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:42.208453 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:42.209225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:42.209660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:42.240895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-90c67624-3ae5-49c6-8d54-74985bfaf5e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047926 Jul 29 13:18:42.241460 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 834/1694] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:43.252793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:43.255423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:43.261930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:43.262384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:43.263158 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:43.263578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:43.299566 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b3d1d7f2-d533-4f90-835c-fc720b6a7b4e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050810 Jul 29 13:18:43.300141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 861/1695] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:44.311840 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:44.314068 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:44.320730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:44.321185 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:44.321987 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:44.322429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:44.353512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b44a15f0-6733-4603-8e7f-53ccff501e01 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045871 Jul 29 13:18:44.354127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 835/1696] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:18:45.367442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:45.369602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:45.376293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:45.376747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:45.377512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:45.377996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:45.413938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3ed7e39-5337-4850-90d5-cbaa8dfb7a70 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051110 Jul 29 13:18:45.414848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 862/1697] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:46.426045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:46.428791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:46.435274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:46.435724 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:46.436510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:46.436930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:46.466852 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-729564aa-1780-4206-bab1-7791c4d7fb23 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044687 Jul 29 13:18:46.467419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 836/1698] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:47.478811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:47.480864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:47.487341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:47.487784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:47.488637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:47.489556 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:47.520275 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3610c5c0-0b4a-4723-874c-192adae420ca tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045409 Jul 29 13:18:47.520953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 863/1699] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:48.168217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:18:48.168401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:18:48.532405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:48.534743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:48.541209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:48.541664 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:48.542470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:48.542925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:48.573596 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1070dfc9-a7e7-44b3-b49d-783867f57607 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045283 Jul 29 13:18:48.574218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 837/1700] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:18:49.586446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:49.588609 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:49.595183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:49.595634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:49.596391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:49.596825 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:49.627469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-98f0ee21-0402-40cf-97fb-1f0801dbb4a5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045415 Jul 29 13:18:49.628041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 864/1701] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:50.639885 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:50.642087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:50.649294 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:50.649749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:50.650555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:50.651000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:50.680925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9e5b9def-71dd-4eb8-b28a-71d5046a5258 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045052 Jul 29 13:18:50.681497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 838/1702] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:51.519107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:18:51.519410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:18:51.693262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:51.695376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:51.701902 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:51.702399 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:51.703118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:51.703557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:51.733169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c69de730-b87c-4c09-8ba4-7a6463dc55d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044421 Jul 29 13:18:51.733933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 865/1703] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:52.746077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:52.748134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:52.754723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:52.755176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:52.755940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:52.756382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:52.787146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e1a41394-d1ef-41f1-9856-73cf790a310b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045345 Jul 29 13:18:52.787706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 839/1704] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:53.799542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:53.802346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:53.808834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:53.809279 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:53.810067 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:53.810510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:53.840210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d89ee24a-c848-4afc-bc47-ab7a88394843 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044730 Jul 29 13:18:53.840773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 866/1705] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:54.856125 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:54.858324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:54.865065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:54.865968 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:54.866558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:54.867067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:54.909251 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bea9f116-1775-4e77-b6cd-6a442fd419a6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059888 Jul 29 13:18:54.909839 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 840/1706] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:55.922437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:55.924632 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:55.926722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:55.932347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:55.933064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:55.934172 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:55.934607 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:55.937384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:55.966679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-589fe382-74e4-42f3-9e5c-d4992603f531 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048359 Jul 29 13:18:55.967250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 867/1707] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:56.980377 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:56.982476 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:56.984531 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:56.990435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:56.991152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:56.991920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:56.992359 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:56.994932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:18:57.023530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-bfa86322-52c4-4d96-936c-1672cc8aad16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047189 Jul 29 13:18:57.024086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 841/1708] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:58.035656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:58.038404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:58.045013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:58.045473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:58.046271 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:58.046804 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:58.076284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bf3bed2d-961a-4a99-8abb-9a8d7889cf81 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044480 Jul 29 13:18:58.076836 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 868/1709] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:18:59.088432 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:18:59.090697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:18:59.097180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:59.097645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:59.099026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:18:59.099461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:18:59.130960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7506b792-8882-45ad-af65-eaffa5e1bc7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046333 Jul 29 13:18:59.131519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 842/1710] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:18:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:00.143107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:00.145291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:00.151797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:00.152267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:00.153032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:00.153476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:00.183585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d798b1c2-6844-4fc8-815a-67b6902049f4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044430 Jul 29 13:19:00.184137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 869/1711] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:01.196543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:01.198705 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:01.205139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:01.205590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:01.206383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:01.206819 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:01.236700 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-99adb301-548e-4e31-bf21-c19cd675d289 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045182 Jul 29 13:19:01.237246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 843/1712] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:02.249698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:02.251883 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:02.258825 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:02.259282 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:02.260056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:02.260502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:02.291288 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f29242f0-8bd0-4fc5-a1e7-7a04f8809eed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045508 Jul 29 13:19:02.291841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 870/1713] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:03.303474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:03.305636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:03.314708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:03.315171 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:03.315947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:03.316386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:03.345752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a97275f5-985b-49fb-a6af-e319bd6b36ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046743 Jul 29 13:19:03.346325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 844/1714] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:03.629751 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:19:03.630320 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:19:04.358302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:04.360468 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:04.367633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:04.368110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:04.368872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:04.369342 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:04.399473 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-17b18fea-a5d3-4315-84b3-148d0c2bce74 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045185 Jul 29 13:19:04.400018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 871/1715] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:05.412135 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:05.414318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:05.420712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:05.421174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:05.421977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:05.422417 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:05.452156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c36c0fd6-d41e-43ff-8c73-1e6341c817aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044502 Jul 29 13:19:05.452714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 845/1716] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:06.464661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:06.466827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:06.473286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:06.473735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:06.474541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:06.474977 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:06.505351 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d1c91797-0dd8-4c72-8af7-8255846cc254 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043841 Jul 29 13:19:06.506280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 872/1717] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:07.521916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:07.524130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:07.530586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:07.531043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:07.531816 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:07.532263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:07.561648 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3a7be62a-a82b-4492-b035-7a97feeea3b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043676 Jul 29 13:19:07.562231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 846/1718] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:08.574186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:08.576400 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:08.583832 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:08.584293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:08.585072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:08.585515 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:08.615135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-19306a44-a2a5-4101-97b7-4b74a49c11d5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044863 Jul 29 13:19:08.615682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 873/1719] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:09.627254 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:09.629383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:09.636751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:09.637208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:09.638078 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:09.638523 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:09.668100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c5aaab15-be62-4932-a994-a0e7092b5ea7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044702 Jul 29 13:19:09.668655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 847/1720] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:10.680270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:10.682460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:10.689267 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:10.689720 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:10.690522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:10.690969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:10.722008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2119969e-56c1-4fec-83f2-915c148c39b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045553 Jul 29 13:19:10.722562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 874/1721] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:11.734084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:11.736249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:11.743729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:11.744179 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:11.744945 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:11.745376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:11.775630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c251cf0e-4895-4ab0-98ee-3a8d33d18678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045487 Jul 29 13:19:11.776168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 848/1722] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:12.788301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:12.790489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:12.797010 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:12.797463 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:12.798252 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:12.798686 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:12.827517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-24a828b9-6a2b-4fde-ac9b-ca92d1853fe5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043778 Jul 29 13:19:12.828213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 875/1723] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:13.304318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:19:13.304896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:19:13.839557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:13.841691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:13.848628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:13.849073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:13.849859 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:13.850307 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:13.881173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9acf34fd-6256-4db7-a5e7-676e6e8286f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045496 Jul 29 13:19:13.881727 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 849/1724] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:14.894884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:14.897543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:14.904165 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:14.904708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:14.905489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:14.905962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:14.935455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1da940c5-6972-4834-9628-54441cbfd3f2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044486 Jul 29 13:19:14.935996 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 876/1725] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:15.948458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:15.950629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:15.956960 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:15.957406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:15.958851 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:15.959299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:15.988232 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f6d06d0c-416e-4ee7-8d14-f946b64581b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043637 Jul 29 13:19:15.988800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 850/1726] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:16.999913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:17.002142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:17.009960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:17.010420 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:17.011183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:17.011625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:17.040831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bb9e499b-31c8-4c08-bad8-d9ec3b16fad2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044737 Jul 29 13:19:17.041378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 877/1727] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:18.053261 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:18.055616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:18.062256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:18.062712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:18.063482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:18.063926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:18.093398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0aa7a116-27da-455b-8799-2885d93f85c9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044792 Jul 29 13:19:18.093983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 851/1728] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:19.105877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:19.108041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:19.114772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:19.115237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:19.116280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:19.116731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:19.147230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f5ca3203-539e-4240-9970-2be8d57e89c3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045455 Jul 29 13:19:19.147792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 878/1729] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:20.159313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:20.162087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:20.168462 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:20.168913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:20.169676 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:20.170141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:20.198754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-01639062-9b7f-43d7-a56c-6d05a5cdd2da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043334 Jul 29 13:19:20.199289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 852/1730] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:21.210857 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:21.212979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:21.219326 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:21.219776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:21.220530 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:21.220962 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:21.251305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6cde5885-ad2b-4315-936b-2ab26ccd4175 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044175 Jul 29 13:19:21.251783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 879/1731] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:22.263657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:22.265942 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:22.277181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:22.277181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:22.277181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:22.277181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:22.308341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-674de71f-c742-470c-a99f-43a3520e26b5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048530 Jul 29 13:19:22.308883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 853/1732] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:23.323246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:23.325385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:23.332168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:23.332740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:23.333593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:23.334273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:23.364420 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-610f7275-6785-4e82-a20b-033d656a5624 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044675 Jul 29 13:19:23.364980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 880/1733] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:24.376955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:24.379681 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:24.386499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:24.386978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:24.387782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:24.388229 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:24.418401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4712e651-7833-4dfd-a45e-27d1a944b40f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045501 Jul 29 13:19:24.418972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 854/1734] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:25.430702 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:25.433041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:25.439186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:25.439656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:25.440483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:25.440921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:25.471301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-875b22c3-1ffc-4b3b-9b58-b131a384097e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044619 Jul 29 13:19:25.471840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 881/1735] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:26.484095 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:26.486337 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:26.493464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:26.493957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:26.494729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:26.495169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:26.523731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2cb7dc3d-ad4d-4d6f-b0ca-84dd6aae4481 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043515 Jul 29 13:19:26.526578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 855/1736] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:27.536458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:27.538629 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:27.542170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:19:27.546211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:27.546678 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:27.547455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:27.547896 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:27.551032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:19:27.578772 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c6dffa89-389b-4a40-874e-37bd562ed6a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047362 Jul 29 13:19:27.579323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 882/1737] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:28.591381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:28.593494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:28.595911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:19:28.601798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:28.602269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:28.603021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:28.603454 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:28.606046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:19:28.633339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-86eb2d7d-237c-4640-90c2-82d3ba966e38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045791 Jul 29 13:19:28.633812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 856/1738] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:29.645421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:29.647589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:29.654809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:29.655276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:29.656062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:29.656507 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:29.687426 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-56787b10-067e-485b-81fd-ab38fca3553b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045946 Jul 29 13:19:29.687992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 883/1739] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:30.700418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:30.702682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:30.709601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:30.710090 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:30.710850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:30.711290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:30.742626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1fb1e77c-f402-4063-a7de-8ac0978bc90d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045913 Jul 29 13:19:30.743114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 857/1740] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:31.753949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:31.756124 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:31.762558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:31.763011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:31.763771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:31.764207 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:31.793222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b09ae6c4-b2ac-46a4-bfca-e871995612a0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043178 Jul 29 13:19:31.793704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 884/1741] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:32.805098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:32.807298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:32.813814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:32.814300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:32.815067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:32.815511 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:32.844763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-45034a6f-8282-4a64-963a-03e68d6baa4a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044145 Jul 29 13:19:32.845248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 858/1742] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:33.856564 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:33.858778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:33.865494 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:33.865976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:33.866992 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:33.867431 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:33.897276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-38378a32-be10-4191-8da3-581853e55204 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044544 Jul 29 13:19:33.897762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 885/1743] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:34.909272 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:34.911967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:34.918539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:34.919000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:34.919823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:34.920267 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:34.950381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7c822391-c328-4106-9536-18760523bc43 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044996 Jul 29 13:19:34.950923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 859/1744] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:35.962171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:35.964478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:35.970976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:35.971427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:35.972182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:35.972621 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:36.003189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-18918e7e-e1aa-444f-8293-573a829aec3d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044816 Jul 29 13:19:36.004876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 886/1745] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:37.072114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:37.074243 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:37.080730 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:37.081188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:37.082654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:37.083104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:37.112154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4a7d05a4-1a89-4c6f-b6fc-36065ce3f8b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044059 Jul 29 13:19:37.112711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 860/1746] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:38.124747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:38.126869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:38.133439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:38.133928 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:38.134688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:38.135124 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:38.164778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a18b29b5-b2ad-4c7f-b0fa-dee0b4105f06 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044083 Jul 29 13:19:38.165325 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 887/1747] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:39.177663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:39.179841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:39.186313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:39.186759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:39.187512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:39.187946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:39.216086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0e2f8237-1d84-4cb2-aa28-4a7f23a16eaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042988 Jul 29 13:19:39.216617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 861/1748] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:40.228147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:40.230335 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:40.236940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:40.237338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:40.238656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:40.239104 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:40.270230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0c508635-28af-4741-8e66-fd1e21f0da85 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045962 Jul 29 13:19:40.270784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 888/1749] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:41.282396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:41.284534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:41.291630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:41.292087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:41.292854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:41.293299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:41.323075 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6a4c7023-2773-40f8-9503-0ad841bc5fc6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044771 Jul 29 13:19:41.323647 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 862/1750] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:42.335253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:42.337404 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:42.343856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:42.344312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:42.345079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:42.345528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:42.375589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3143745b-5d7f-4df9-92f0-bd168b87cc29 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044193 Jul 29 13:19:42.376074 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 889/1751] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:43.386767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:43.388813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:43.395228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:43.395672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:43.396419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:43.396850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:43.424946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-60d50f99-9a45-4753-a691-1de52e9b6db4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042182 Jul 29 13:19:43.425989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 863/1752] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:44.437914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:44.439978 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:44.446497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:44.446949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:44.447704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:44.448139 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:44.477176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-78d25f2d-cc4b-49ed-b130-b330d44b451e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043311 Jul 29 13:19:44.477727 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 890/1753] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:45.488944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:45.491397 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:45.497792 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:45.498274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:45.499039 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:45.499483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:45.529146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-428f9e0d-2aa8-488f-9c01-cfa44e7dd08c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044577 Jul 29 13:19:45.529706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 864/1754] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:46.541123 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:46.543934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:46.551016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:46.551466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:46.552303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:46.552930 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:46.584701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0ec081b9-4603-44d1-b597-7cc48b016c04 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047498 Jul 29 13:19:46.585257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 891/1755] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:47.595967 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:47.598138 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:47.604674 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:47.605116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:47.605911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:47.606355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:47.635382 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e3b58919-80a8-4f01-b8ea-94caec90da3b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043366 Jul 29 13:19:47.635930 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 865/1756] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:48.647643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:48.649840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:48.656476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:48.656931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:48.657697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:48.658171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:48.687362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-680e7652-1062-44b7-b258-b997bcff0976 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043714 Jul 29 13:19:48.687915 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 892/1757] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:49.700325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:49.702499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:49.709699 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:49.710189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:49.710963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:49.711402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:49.739928 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-669f4e89-2908-4a5d-86ca-e33f5d7922d8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043553 Jul 29 13:19:49.740478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 866/1758] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:50.751800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:50.754542 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:50.760964 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:50.761412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:50.762206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:50.762638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:50.791884 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1c2572d1-5a05-4944-b792-40facbfce280 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044057 Jul 29 13:19:50.792447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 893/1759] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:51.804539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:51.806703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:51.813514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:51.814010 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:51.814778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:51.815222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:51.845526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5a6157ef-5f91-4028-ae5d-4de72d70743e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045431 Jul 29 13:19:51.846108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 867/1760] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:52.857706 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:52.860133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:52.867858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:52.868316 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:52.869091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:52.869536 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:52.898552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4abbbace-0731-4b71-b23d-fc753bb0137d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044751 Jul 29 13:19:52.899102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 894/1761] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:53.911445 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:53.913588 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:53.920014 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:53.920464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:53.921219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:53.921662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:53.950103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6ece8597-790d-41f3-ad2c-6268f850507e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043157 Jul 29 13:19:53.950673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 868/1762] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:54.963306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:54.965449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:54.971541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:54.972016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:54.972780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:54.973214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:55.001988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ab4321a7-815d-4cf5-a063-ad692b80dc5d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042871 Jul 29 13:19:55.002534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 895/1763] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:56.014920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:56.017045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:56.023637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:56.024103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:56.024874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:56.025340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:56.055611 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7c456cec-b265-4c79-b9cf-e35cf0868afb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044651 Jul 29 13:19:56.056166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 869/1764] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:57.067755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:57.069951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:57.076395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:57.076844 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:57.077600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:57.078061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:57.107635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5d1cc85f-8e76-4184-a064-74accee47b4c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043815 Jul 29 13:19:57.108627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 896/1765] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:58.120116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:58.122294 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:58.129283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:58.129786 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:58.130538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:58.130978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:58.160565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-65a30416-465d-4670-b07d-0f7883438d3c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044553 Jul 29 13:19:58.161119 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 870/1766] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:19:59.172610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:19:59.174809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:19:59.177711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:19:59.183078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:59.183528 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:59.184289 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:19:59.184728 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:19:59.188475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:19:59.219714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-63dbb741-47a2-4dc3-804a-1db5aa269c63 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050931 Jul 29 13:19:59.220213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 897/1767] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:19:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:00.231895 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:00.234063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:00.236441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:20:00.242601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:00.243052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:00.243808 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:00.244244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:00.246590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:20:00.275929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-72600ea9-d93e-4805-96c9-adf11e51f35d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047935 Jul 29 13:20:00.276494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 871/1768] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:01.289118 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:01.291779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:01.298748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:01.299198 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:01.299968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:01.300385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:01.329105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-099b2db2-99c6-4011-8bee-c0857ca92ee6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044928 Jul 29 13:20:01.329656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 898/1769] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:02.341903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:02.344026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:02.350649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:02.351108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:02.351875 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:02.352313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:02.382202 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-123aeced-5a5b-458f-9077-c579f4f33505 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044370 Jul 29 13:20:02.382747 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 872/1770] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:03.395380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:03.397499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:03.403998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:03.404451 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:03.405217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:03.405660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:03.434049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4d6fa801-d42e-42f5-b46e-71f260f493d0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043609 Jul 29 13:20:03.434594 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 899/1771] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:04.446298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:04.448406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:04.454781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:04.455227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:04.455983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:04.456988 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:04.486037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-dd16bec8-62a2-40ec-86d4-4ab0b34bbcda tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043642 Jul 29 13:20:04.486573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 873/1772] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:05.498231 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:05.500413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:05.507020 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:05.507475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:05.508237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:05.508677 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:05.537790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a220dfdd-af03-48a0-97e7-d206f1eff888 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043522 Jul 29 13:20:05.538362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 900/1773] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:06.550454 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:06.552578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:06.559017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:06.559475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:06.560253 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:06.560695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:06.589920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a4eca773-6d01-42dd-94d8-4b3d02633fb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043401 Jul 29 13:20:06.590470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 874/1774] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:07.602155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:07.604330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:07.610854 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:07.611311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:07.612078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:07.613035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:07.642878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-21ea6082-9f2f-419f-b566-bedaa8bd3656 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044779 Jul 29 13:20:07.643420 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 901/1775] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:08.655178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:08.657338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:08.664974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:08.665427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:08.666228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:08.666666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:08.695755 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8ccbba6b-7efc-41c5-be4f-d3457b9fd036 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044489 Jul 29 13:20:08.696301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 875/1776] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:09.708400 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:09.710555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:09.717008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:09.717453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:09.718242 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:09.718675 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:09.747893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dee25e57-2e7c-49da-88e4-afeedc3b50a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043930 Jul 29 13:20:09.748430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 902/1777] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:10.760203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:10.762383 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:10.769473 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:10.769962 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:10.770734 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:10.771176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:10.799956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6abe70d5-d4eb-48d2-8cee-25615f5f5e75 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043710 Jul 29 13:20:10.800506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 876/1778] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:11.811167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:11.813291 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:11.820319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:11.820765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:11.821518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:11.821988 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:11.850013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8a091d76-37b5-489f-aba7-523d53a3e287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042673 Jul 29 13:20:11.850547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 903/1779] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:12.862073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:12.864296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:12.871049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:12.871493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:12.872245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:12.872698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:12.906387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4380de70-1d14-4d89-8dbc-edc3f114a695 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048087 Jul 29 13:20:12.906879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 877/1780] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:13.920083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:13.922304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:13.929293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:13.929743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:13.930554 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:13.930994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:13.959506 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-40736701-befd-4628-9eac-81ada612149b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043391 Jul 29 13:20:13.960062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 904/1781] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:14.971092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:14.973949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:14.980626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:14.981101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:14.981933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:14.982371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:15.011526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-02220492-d61f-4090-8980-a67b4111813e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044405 Jul 29 13:20:15.012073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 878/1782] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:16.024384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:16.027030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:16.036382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:16.037006 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:16.037993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:16.038576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:16.069116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7025cbe6-04c5-406b-9e14-46cd2fe9d84a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049392 Jul 29 13:20:16.069681 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 905/1783] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:17.080866 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:17.082741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:17.089044 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:17.089491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:17.090283 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:17.090718 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:17.121349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-50c8e2bd-5024-4eba-baaf-67b23106d0f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044662 Jul 29 13:20:17.122538 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 879/1784] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:18.134262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:18.136920 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:18.144863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:18.145317 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:18.146122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:18.146556 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:18.175826 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cd5a6d59-3139-4d67-b095-5f0fbf778c2c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046628 Jul 29 13:20:18.176380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 906/1785] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:19.187978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:19.190212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:19.196636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:19.197084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:19.197854 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:19.198313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:19.227715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2ca27e97-2ca6-4983-b2a7-3aec1e40ed3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043718 Jul 29 13:20:19.228253 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 880/1786] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:20.240491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:20.246570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:20.254082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:20.254534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:20.256011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:20.256312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:20.285453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-131bc172-83a1-4295-9681-1d830686e1b0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049461 Jul 29 13:20:20.286045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 907/1787] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:21.297954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:21.300092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:21.306837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:21.307280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:21.308046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:21.308476 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:21.338285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3a4ffe96-4e44-45b3-8cac-533ec27860d9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044513 Jul 29 13:20:21.339001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 881/1788] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:22.350458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:22.353185 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:22.359952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:22.360409 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:22.361210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:22.361650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:22.391375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ff171f96-f21b-4d22-b29e-123b4db915e2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044812 Jul 29 13:20:22.391916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 908/1789] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:23.404128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:23.406290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:23.413319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:23.413771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:23.414572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:23.415012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:23.449791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b31190ef-5510-46ae-a68e-c66b85696bbb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049653 Jul 29 13:20:23.450390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 882/1790] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:24.462120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:24.464272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:24.471027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:24.471390 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:24.472083 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:24.472524 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:24.502924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0526afed-6b37-4fa7-906c-c198f7ad9e0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044883 Jul 29 13:20:24.504671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 909/1791] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:25.515626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:25.517768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:25.525069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:25.525446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:25.526262 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:25.526708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:25.558045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5e6f5ce5-1693-4483-8452-ef0ccdb57d5f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046233 Jul 29 13:20:25.558619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 883/1792] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:26.571123 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:26.573273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:26.579272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:26.579724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:26.580497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:26.580936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:26.611952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-82bd9bc4-4401-4486-a56d-c21d6e50291e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045427 Jul 29 13:20:26.612517 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 910/1793] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:27.624226 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:27.626439 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:27.632461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:27.632916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:27.633685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:27.634156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:27.664556 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a7ef5ee3-4694-4294-938a-695c46e760e6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044353 Jul 29 13:20:27.665789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 884/1794] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:28.676656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:28.679479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:28.685919 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:28.686373 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:28.687132 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:28.687570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:28.716612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-61618f42-6c7f-44de-88e3-4198c85d883d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044004 Jul 29 13:20:28.717403 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 911/1795] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:29.125953 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:20:29.126103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:20:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:20:29.728214 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:29.730399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:29.736874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:29.737333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:29.738144 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:29.738586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:29.770247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-42b2e990-2e82-4939-90a9-16c309f5fa64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045972 Jul 29 13:20:29.770813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 885/1796] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:30.783216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:30.785492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:30.787968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:20:30.793048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:30.793502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:30.794346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:30.794841 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:30.799151 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:20:30.827876 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4ab76182-73cd-449f-bc4c-91c844f6f244 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048948 Jul 29 13:20:30.828439 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 912/1797] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:31.840327 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:31.842492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:31.844887 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:20:31.850227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:31.851167 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:31.851916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:31.852349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:31.854906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:20:31.883665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6ea60ec9-8358-40b9-8066-3dfad4294774 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047239 Jul 29 13:20:31.884248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 886/1798] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:20:32.896173 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:32.898446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:32.905072 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:32.905516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:32.906308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:32.906789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:32.936050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c874c253-78ae-4b67-ab49-779a85fe2559 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043985 Jul 29 13:20:32.936603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 913/1799] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:33.947903 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:33.950142 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:33.956739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:33.957193 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:33.957994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:33.958436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:33.987438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3c93b64b-8151-4982-bcfe-5ca408319c35 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043487 Jul 29 13:20:33.987996 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 887/1800] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:20:35.000433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:35.002744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:35.009768 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:35.010243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:35.010997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:35.011487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:35.040142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c583f8b0-b895-4b1c-9d67-cdb1985d68a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043657 Jul 29 13:20:35.040687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 914/1801] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:36.052467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:36.054706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:36.061159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:36.061675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:36.062603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:36.063092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:36.092687 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0733ec22-f95b-4a7b-b443-0482c5dbf8a3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044246 Jul 29 13:20:36.093249 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 888/1802] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:37.105472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:37.107665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:37.114239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:37.114688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:37.115458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:37.115897 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:37.146215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-da4b49f9-729e-424b-88e7-fadf891d0669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045259 Jul 29 13:20:37.146774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 915/1803] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:38.159077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:38.161227 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:38.167781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:38.168237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:38.169002 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:38.169441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:38.198333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2af61c7a-6197-4b30-9d3b-60d761dd7287 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043160 Jul 29 13:20:38.198886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 889/1804] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:39.210595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:39.212815 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:39.219304 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:39.219758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:39.220522 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:39.220961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:39.251145 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-43a1208d-df08-4b5f-99e3-97235da5c9b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044559 Jul 29 13:20:39.251684 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 916/1805] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:40.264092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:40.266280 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:40.272663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:40.273764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:40.274547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:40.274984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:40.303510 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2dfe6bc2-b034-4b4c-9241-be9d94c54ed6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043337 Jul 29 13:20:40.304054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 890/1806] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:41.315813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:41.317994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:41.325216 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:41.325661 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:41.326452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:41.326882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:41.355475 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-09a73414-af9d-4781-a0ee-14d6fd5dcb84 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043623 Jul 29 13:20:41.356115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 917/1807] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:42.368641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:42.370736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:42.377246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:42.377702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:42.378505 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:42.378952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:42.407846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cff38818-2f95-4b55-9bad-709e99352c69 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043833 Jul 29 13:20:42.408399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 891/1808] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:43.420057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:43.422237 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:43.428778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:43.429274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:43.430075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:43.430518 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:43.459395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cb6c3a78-0c62-4e1f-adb2-4d83cf77bfb6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043396 Jul 29 13:20:43.459933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 918/1809] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:44.472189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:44.474290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:44.480706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:44.481162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:44.481955 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:44.482406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:44.512567 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fcae8020-0b06-4662-8c79-def2bfd13a17 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044240 Jul 29 13:20:44.513154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 892/1810] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:45.525045 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:45.527204 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:45.533562 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:45.534056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:45.534809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:45.535241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:45.565666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6d245981-e7d5-4789-bd9b-eab54b6ad803 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044684 Jul 29 13:20:45.566236 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 919/1811] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:46.577973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:46.580157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:46.586597 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:46.587055 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:46.587821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:46.588264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:46.617310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-55ff6e1e-4722-4292-8d2e-82a03655c6f3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042777 Jul 29 13:20:46.617874 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 893/1812] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:47.629881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:47.631987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:47.638965 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:47.639436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:47.640189 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:47.640622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:47.669558 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8daf0832-5e66-449f-886e-62ba583dccfa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043679 Jul 29 13:20:47.670129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 920/1813] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:48.681915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:48.684076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:48.690492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:48.690944 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:48.691708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:48.692147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:48.720479 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a9db0767-05f3-4c96-b515-ad0f74b11e9c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043236 Jul 29 13:20:48.721028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 894/1814] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:49.732559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:49.734740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:49.741137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:49.742387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:49.743199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:49.743641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:49.772948 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c3a9da39-762d-4319-a6fa-55eae2ccc622 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044325 Jul 29 13:20:49.773501 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 921/1815] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:50.784474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:50.786750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:50.793120 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:50.793576 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:50.794365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:50.794800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:50.824442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-888baac5-e426-41f8-817f-3c7f97af66f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043835 Jul 29 13:20:50.825040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 895/1816] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:51.836852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:51.839046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:51.845591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:51.846078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:51.846838 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:51.847272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:51.876433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a8292819-d065-4a61-ae6f-4be139f9ae8f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043591 Jul 29 13:20:51.876973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 922/1817] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:52.889233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:52.891387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:52.897918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:52.898374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:52.899140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:52.899580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:52.928330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0875ddb1-262f-4c76-934b-5a8ec20386c7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043081 Jul 29 13:20:52.928906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 896/1818] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:53.941713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:53.943900 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:53.951031 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:53.951478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:53.952257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:53.952691 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:53.982270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3639e76a-832a-419c-82a4-fdee5fdc8ca1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044724 Jul 29 13:20:53.982821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 923/1819] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:54.995302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:54.997450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:55.003863 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:55.004312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:55.005086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:55.005519 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:55.034741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d51d4131-4d0f-4346-86ea-a91fa2846dac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044235 Jul 29 13:20:55.035301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 897/1820] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:56.047195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:56.049374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:56.055387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:56.055865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:56.056625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:56.057057 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:56.086311 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d6218f75-9dce-47f2-8db6-cde021bca65f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043219 Jul 29 13:20:56.086855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 924/1821] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:57.099688 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:57.101813 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:57.108452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:57.108908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:57.109682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:57.110154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:57.139997 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2e4ff37f-58a5-4837-8a5c-5d52784e1800 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044372 Jul 29 13:20:57.140574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 898/1822] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:58.152296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:58.154497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:58.160892 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:58.161331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:58.162107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:58.162539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:58.192064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b3db258-b3e3-4ccd-b8ea-cedac013a8af tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043798 Jul 29 13:20:58.192603 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 925/1823] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:20:59.205086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:20:59.207364 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:20:59.214551 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:59.214991 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:59.215770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:20:59.216216 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:20:59.247121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2602c9ca-95f6-4345-992d-9cf4381992d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045952 Jul 29 13:20:59.247678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 899/1824] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:20:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:00.259519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:00.261663 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:00.268096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:00.268547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:00.269305 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:00.269747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:00.298110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cf308d47-9df0-42b3-a43d-3fb143b4ab64 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043136 Jul 29 13:21:00.298639 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 926/1825] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:01.311470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:01.313587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:01.320108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:01.320555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:01.321334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:01.321768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:01.350271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-da8ed76e-4d19-4af3-bacc-4c00c968550f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042970 Jul 29 13:21:01.350835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 900/1826] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:02.363217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:02.365383 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:02.368068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:02.373742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:02.374206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:02.375087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:02.375579 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:02.379354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:02.406068 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cd40928c-2df0-41f6-b19f-05e7c500724b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046872 Jul 29 13:21:02.406665 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 927/1827] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:03.418450 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:03.420542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:03.422980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:03.428318 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:03.428771 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:03.429544 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:03.430045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:03.433775 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:03.460004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0d45628c-8bdd-4519-8a38-0c4ab549b192 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045639 Jul 29 13:21:03.460769 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 901/1828] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:04.472748 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:04.474983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:04.482122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:04.482570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:04.483322 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:04.483758 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:04.513082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e82e6a51-abd0-4f21-b8a2-66e7ff504683 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044310 Jul 29 13:21:04.513642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 928/1829] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:05.524927 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:05.527640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:05.534312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:05.534794 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:05.535566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:05.536035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:05.565743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-333c0106-6428-4f23-af5c-7827241c9331 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044757 Jul 29 13:21:05.566326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 902/1830] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:06.578257 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:06.580419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:06.586880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:06.587331 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:06.588662 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:06.589103 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:06.617793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f7613280-e4d7-4a8f-ba7d-ae1d45c56f26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043490 Jul 29 13:21:06.618360 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 929/1831] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:07.630081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:07.632300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:07.638711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:07.639168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:07.639933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:07.640377 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:07.670172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-64f8ac26-ae24-4bb4-9ba0-06461cafc3da tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044050 Jul 29 13:21:07.670759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 903/1832] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:08.683385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:08.685585 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:08.692143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:08.692596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:08.693366 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:08.693809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:08.722543 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-91adc9a8-d19a-429b-8eb2-f0b5dd616939 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043820 Jul 29 13:21:08.723090 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 930/1833] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:09.734720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:09.736862 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:09.744419 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:09.744910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:09.745677 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:09.746151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:09.775474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-97d5835c-bbe4-4460-98b6-7a8ce733516b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044758 Jul 29 13:21:09.776027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 904/1834] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:10.787540 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:10.789685 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:10.796235 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:10.796692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:10.797459 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:10.797926 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:10.828152 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1d0da02e-8a26-4863-a0d7-366ac024406b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044580 Jul 29 13:21:10.828704 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 931/1835] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:11.841130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:11.843325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:11.849784 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:11.850285 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:11.851053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:11.851499 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:11.881657 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b9da858e-41ae-4003-8501-f72de308234b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045233 Jul 29 13:21:11.882260 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 905/1836] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:12.894635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:12.896732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:12.903293 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:12.903746 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:12.904516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:12.904958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:12.934229 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-eb4e9dbd-3048-4245-ae91-91c909db602a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043684 Jul 29 13:21:12.934786 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 932/1837] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:13.946846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:13.949099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:13.957791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:13.958271 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:13.959035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:13.959475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:13.995824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-211256b9-227f-49dc-804b-bd5686339f48 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052803 Jul 29 13:21:13.996420 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 906/1838] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:15.010493 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:15.012625 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:15.019102 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:15.019548 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:15.020307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:15.020744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:15.049799 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d404e4a9-ae15-45b1-82e6-cb1767ae6314 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043962 Jul 29 13:21:15.050312 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 933/1839] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:16.062447 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:16.064644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:16.071081 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:16.071532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:16.072871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:16.073312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:16.103914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-499fa773-a4d4-4c75-8c6a-55dacce681f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045325 Jul 29 13:21:16.104474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 907/1840] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:17.115454 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:17.117874 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:17.124340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:17.124789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:17.125547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:17.126005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:17.155602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1827cc2e-5631-4055-bf76-5048adcbca98 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044069 Jul 29 13:21:17.156149 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 934/1841] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:18.168467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:18.170629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:18.177152 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:18.177605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:18.178403 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:18.178846 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:18.209363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f2655ba8-229e-46ee-a1dd-6e8c27b73de2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045467 Jul 29 13:21:18.209929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 908/1842] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:19.221752 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:19.223924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:19.230943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:19.231396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:19.232161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:19.232602 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:19.261955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aa16a109-b683-499c-afb2-e6391cc45e6e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044195 Jul 29 13:21:19.262500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 935/1843] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:21:20.274015 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:20.276683 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:20.283048 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:20.283498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:20.284247 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:20.284682 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:20.313827 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cd55d775-467e-4100-807f-2b06bc6b9f1f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043759 Jul 29 13:21:20.314390 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 909/1844] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:21.328395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:21.330596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:21.337228 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:21.337703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:21.338489 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:21.338923 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:21.367941 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6fc84859-6cb9-4faf-a430-e2cc6c576ad7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043510 Jul 29 13:21:21.369131 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 936/1845] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:22.380777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:22.382901 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:22.389900 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:22.390361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:22.391130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:22.391571 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:22.420793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2950d88c-17f0-4ead-a8b9-cb3598b64e9d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044017 Jul 29 13:21:22.421333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 910/1846] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:23.432658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:23.434744 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:23.441284 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:23.441743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:23.442547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:23.442991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:23.472196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-beaddcdf-11f4-49a3-b265-78a41408d39a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044058 Jul 29 13:21:23.472747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 937/1847] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:24.484662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:24.486757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:24.493544 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:24.494032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:24.494798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:24.495242 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:24.525741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0ed8edbf-5771-474f-ac4a-466b701859d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045040 Jul 29 13:21:24.526387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 911/1848] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:25.538359 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:25.541089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:25.547120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:25.547565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:25.548315 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:25.548747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:25.577078 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-01dbb50d-bc74-4f68-be33-2054f28fc4de tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042912 Jul 29 13:21:25.577613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 938/1849] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:26.588970 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:26.591173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:26.597308 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:26.597765 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:26.598562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:26.599004 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:26.629861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-58a35058-99af-4e91-a3d9-7c89d079fe3f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044937 Jul 29 13:21:26.630429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 912/1850] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:27.642065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:27.644215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:27.651221 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:27.651671 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:27.652424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:27.652862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:27.681734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b6c73d1f-608e-4ef2-bb01-39bab5c85442 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043566 Jul 29 13:21:27.682245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 939/1851] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:28.692824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:28.695031 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:28.701489 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:28.702000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:28.702767 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:28.703211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:28.732615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c1d017d3-327b-4633-9bc1-1cf33cac3929 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043730 Jul 29 13:21:28.733164 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 913/1852] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:21:29.746210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:29.748559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:29.755303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:29.755749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:29.756611 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:29.758033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:29.788483 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ed0098e7-ab29-4cf1-9b9d-4704feccdb78 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047501 Jul 29 13:21:29.789042 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 940/1853] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:30.801066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:30.803228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:30.810180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:30.810641 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:30.811405 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:30.811842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:30.841356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3b56e243-5266-44f1-8499-d4c8f73bba58 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044149 Jul 29 13:21:30.841954 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 914/1854] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:31.853448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:31.855647 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:31.862155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:31.862600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:31.863349 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:31.863776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:31.892946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cef9fead-4470-44c1-b4ee-68cb7d6ed1f6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043525 Jul 29 13:21:31.893484 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 941/1855] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:32.905137 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:32.907257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:32.913787 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:32.914273 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:32.915534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:32.915980 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:32.945675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-deef9bef-6ae4-4844-8abc-33d544e42bde tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044602 Jul 29 13:21:32.946269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 915/1856] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:33.957024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:33.959240 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:33.961666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:33.966851 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:33.967296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:33.968048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:33.968479 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:33.972175 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:33.998033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-74dd2770-a9e1-4640-8a5b-57d5d6916f2b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044918 Jul 29 13:21:33.998570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 942/1857] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:35.010892 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:35.013030 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:35.015471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:35.020841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:35.021290 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:35.022093 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:35.022530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:35.025655 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:21:35.052783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fd047ede-4900-4889-95e0-a18450280b26 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046316 Jul 29 13:21:35.053338 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 916/1858] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:36.064462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:36.066658 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:36.073770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:36.074246 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:36.075008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:36.075443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:36.104143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e6de5942-6f41-475a-a14d-f837bc071543 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043559 Jul 29 13:21:36.104688 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 943/1859] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:37.116547 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:37.118983 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:37.125373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:37.125844 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:37.126601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:37.127032 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:37.156339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-074ffb34-e6fc-4a95-834a-872f23b52b16 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043799 Jul 29 13:21:37.156887 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 917/1860] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:21:38.169017 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:38.171156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:38.177591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:38.178062 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:38.178813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:38.179244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:38.208191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-28887a1b-dcc8-4bfc-9309-22df2ec5e745 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043663 Jul 29 13:21:38.208738 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 944/1861] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:39.220605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:39.222766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:39.229156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:39.229608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:39.230413 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:39.230851 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:39.260404 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b8d685a9-a7be-4dc8-9ce1-c53265b6b001 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043802 Jul 29 13:21:39.260938 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 918/1862] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:40.272687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:40.274848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:40.281286 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:40.281732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:40.282521 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:40.282954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:40.312578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-97120468-c418-425b-ba35-b232c13b93b9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043969 Jul 29 13:21:40.313138 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 945/1863] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:41.324695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:41.326864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:41.333314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:41.333757 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:41.334546 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:41.334979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:41.372823 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-aae022e7-b216-4e91-b0a1-bc36b0ec32b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051775 Jul 29 13:21:41.373311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 919/1864] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:42.385442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:42.387591 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:42.394008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:42.394452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:42.395201 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:42.395631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:42.424276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-56d2d216-1fa0-484a-be0e-aa87c7fa59a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043140 Jul 29 13:21:42.424813 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 946/1865] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:43.436991 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:43.439346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:43.446713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:43.447169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:43.447937 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:43.448381 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:43.476806 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9dbc022f-9c9f-4f29-ba8d-987f62d5ef95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043821 Jul 29 13:21:43.477351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 920/1866] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:44.489116 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:44.491247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:44.498105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:44.498565 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:44.499332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:44.499776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:44.531831 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bed0193e-fc46-42b1-bb11-6081f6e49e52 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046784 Jul 29 13:21:44.532560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 947/1867] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:45.544495 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:45.546713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:45.553207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:45.553662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:45.554459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:45.554897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:45.583666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d3c8d73a-9c10-4865-9e4c-1c87351afe6c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043160 Jul 29 13:21:45.584207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 921/1868] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:46.596460 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:46.598659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:46.605081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:46.605537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:46.606340 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:46.606811 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:46.637142 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-dd8cf54a-f33f-4dfe-8603-347d7d9e3167 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044600 Jul 29 13:21:46.637698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 948/1869] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:47.649897 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:47.652027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:47.658526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:47.658989 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:47.659754 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:47.660195 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:47.689491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0f4fb37d-64c7-427f-81ec-3825444d875b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044243 Jul 29 13:21:47.690070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 922/1870] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:48.664237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:21:48.665398 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:21:48.701722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:48.703979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:48.710523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:48.710975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:48.712253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:48.712694 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:48.741980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ee3e6ffa-5aa0-4aec-8427-21d7df37d108 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044145 Jul 29 13:21:48.742780 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 949/1871] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:49.754572 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:49.756746 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:49.763867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:49.764310 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:49.765059 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:49.765493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:49.793887 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c2a56e38-1741-429d-ab04-8447fb72612a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043255 Jul 29 13:21:49.794362 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 923/1872] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:50.806094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:50.808268 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:50.814791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:50.815251 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:50.816013 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:50.816453 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:50.846307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-844a7d1c-47c0-4767-89eb-3516991a369c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044185 Jul 29 13:21:50.846784 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 950/1873] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:51.858667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:51.860876 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:51.868001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:51.868454 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:51.869203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:51.869635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:51.898320 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-92a608ff-0af0-40d1-b6da-c90e2c061dcc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043567 Jul 29 13:21:51.898853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 924/1874] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:52.543027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2f9e0494-fc82-454c-8d4e-0f3a720538a1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] Calling method '.version_select at 0x7f74a68f4790>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:52.565309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2f9e0494-fc82-454c-8d4e-0f3a720538a1 tempest-TestVolumeBootPattern-1639178603 tempest-TestVolumeBootPattern-1639178603-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-887022515" status: 202 len: 0 microversion: 2.1 time: 0.026672 Jul 29 13:21:52.565906 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 951/1875] 10.222.0.66 () {58 vars in 1260 bytes} [Fri Jul 29 13:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-887022515 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 13:21:52.910555 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:52.912825 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:52.919886 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:52.920344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:52.921123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:52.921570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:52.953569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-050e5e7c-56c4-433f-93a0-2100b225550e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046863 Jul 29 13:21:52.954165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 925/1876] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:53.966976 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:53.969053 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:53.976046 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:53.976500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:53.977958 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:53.978405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:54.009301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-77b7c0e6-1ee1-430c-ab80-2a1e5a3a1d42 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046982 Jul 29 13:21:54.009900 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 952/1877] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:55.021758 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:55.024169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:55.030707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:55.031159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:55.031934 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:55.032389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:55.069464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-88c4c4ef-770c-4081-a7fe-b08030fd8fc2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051543 Jul 29 13:21:55.070335 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 926/1878] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:56.082644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:56.084858 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:56.092124 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:56.092578 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:56.093343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:56.093777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:56.130361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b08010d3-fd53-43c1-8260-371c0567a333 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051561 Jul 29 13:21:56.138613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 953/1879] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:57.147161 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:57.150028 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:57.156396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:57.157545 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:57.158533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:57.159255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:57.194558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2e7b980a-2da1-476a-a26a-8728a2dcd2b3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051478 Jul 29 13:21:57.195504 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 927/1880] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:58.207694 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:58.209970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:58.216324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:58.216773 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:58.217527 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:58.217994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:58.249141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8b4866d5-a6ef-41a3-bc2b-49ee935ff750 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045372 Jul 29 13:21:58.249950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 954/1881] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:21:59.261312 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:21:59.263909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:21:59.270449 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:59.271188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:59.272049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:21:59.272870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:21:59.306691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1c475689-7455-4b17-a7ce-8e158acd7742 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049608 Jul 29 13:21:59.307401 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 928/1882] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:21:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:00.319265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:00.321985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:00.328440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:00.328892 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:00.329648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:00.330145 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:00.359108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b98512df-6402-48ac-8bb2-f8fef129359e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043863 Jul 29 13:22:00.359645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 955/1883] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:01.371957 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:01.374371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:01.380741 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:01.381196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:01.382000 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:01.382442 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:01.411473 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fdcae47d-e0f6-4b78-a024-98d69072ef62 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044038 Jul 29 13:22:01.412021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 929/1884] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:02.424437 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:02.426798 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:02.433385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:02.433865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:02.434637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:02.435081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:02.465181 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-badefcb7-ed67-4c6d-ad66-f8cee4764862 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044827 Jul 29 13:22:02.465732 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 956/1885] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:03.476627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:03.478751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:03.485205 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:03.485659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:03.486500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:03.486941 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:03.517065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-17d701bc-bd46-4947-95c6-c8c08d949205 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044490 Jul 29 13:22:03.517609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 930/1886] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:04.529613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:04.531803 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:04.534124 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:04.539869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:04.540394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:04.541180 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:04.541622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:04.544894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=84 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:04.573443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2455ec65-d603-4c7e-8279-4fd50d9cbc6b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047783 Jul 29 13:22:04.574030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 957/1887] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:05.585624 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:05.588351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:05.590627 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:05.595777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:05.596225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:05.596977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:05.597414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:05.599949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:05.626871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-73993aa4-ac3a-46e3-a1dc-4e352cfd6248 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045180 Jul 29 13:22:05.627415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 931/1888] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:05 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:06.639001 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:06.641217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:06.647852 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:06.648362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:06.649695 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:06.650156 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:06.678594 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9b15e49a-fbd1-4e7a-80ec-738fb00bb1ed tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043588 Jul 29 13:22:06.679141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 958/1889] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:07.691178 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:07.693311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:07.700751 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:07.701211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:07.702076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:07.702525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:07.732629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b82d33d1-1fa2-4f42-a685-81dfe166e979 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045364 Jul 29 13:22:07.733173 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 932/1890] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:08.177389 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:22:08.177848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:22:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:22:08.745726 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:08.747790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:08.754328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:08.754774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:08.755534 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:08.755968 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:08.784673 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-07cc0021-e5f3-4ebc-b709-b72d96646e7b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043866 Jul 29 13:22:08.785211 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 959/1891] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:09.797606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:09.799856 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:09.806923 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:09.807370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:09.808176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:09.808609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:09.839799 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6b010eb4-2401-4e0c-8cd3-fe70daf361ee tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046152 Jul 29 13:22:09.840339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 933/1892] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:10.853991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:10.857159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:10.864309 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:10.864756 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:10.865730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:10.866176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:10.895782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-da7ea25c-0d62-41af-8cbb-a4ce0c6a59d6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046974 Jul 29 13:22:10.896338 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 960/1893] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:11.528188 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:22:11.528643 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:22:11.908592 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:11.910726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:11.917636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:11.918116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:11.918870 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:11.919305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:11.948890 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d6c410fa-9f55-47ce-9948-a4e457d528c8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044198 Jul 29 13:22:11.949433 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 934/1894] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:12.961098 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:12.963256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:12.969648 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:12.970119 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:12.970871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:12.971301 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:13.000608 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f4d6553d-1b9e-4822-9a6d-824d348e7fc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043959 Jul 29 13:22:13.001147 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 961/1895] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:14.013580 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:14.015919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:14.022374 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:14.022828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:14.024213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:14.024656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:14.053334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8b29559e-ad43-49c0-b9a8-fe57503ff7f8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044213 Jul 29 13:22:14.053833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 935/1896] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:15.065760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:15.067944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:15.074510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:15.074955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:15.075730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:15.076162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:15.105610 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c11d5c5e-e22f-4a20-a94b-835499aa88ff tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043696 Jul 29 13:22:15.106108 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 962/1897] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:16.118756 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:16.120880 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:16.127341 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:16.127785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:16.128541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:16.128984 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:16.165908 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a313ca2e-ba9a-482c-a9ba-6a7b928e6416 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051903 Jul 29 13:22:16.166412 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 936/1898] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:17.177620 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:17.180458 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:17.187238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:17.187705 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:17.188495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:17.188937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:17.219217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-41a2e21c-d8ed-418a-a3f7-3f3242c81170 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045534 Jul 29 13:22:17.219708 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 963/1899] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:18.232128 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:18.234330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:18.240913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:18.241366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:18.242210 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:18.242906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:18.271512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3197f311-70d7-488f-ba90-edf6790bb4e8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043273 Jul 29 13:22:18.272001 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 937/1900] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:19.284376 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:19.286539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:19.293478 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:19.293971 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:19.294743 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:19.295182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:19.473984 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8216c73f-2c55-41ed-9975-91d44ebca4a2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.193428 Jul 29 13:22:19.474447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 964/1901] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:20.487170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:20.489244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:20.495966 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:20.496416 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:20.497175 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:20.497615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:20.526768 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1b8cbd3c-80ac-4b84-993d-84b9be2beaea tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043623 Jul 29 13:22:20.527306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 938/1902] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:21.539233 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:21.541303 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:21.547742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:21.548191 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:21.548949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:21.549384 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:21.583452 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e1b55bcc-3782-4849-bedd-3df9a44efb8a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048745 Jul 29 13:22:21.584012 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 965/1903] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:22.596532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:22.598703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:22.607488 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:22.607949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:22.608742 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:22.611097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:22.640595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fe2c46e2-3738-4f3a-9ffc-288922c8025e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047982 Jul 29 13:22:22.641149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 939/1904] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:23.637755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:22:23.638345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:22:23.652927 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:23.655105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:23.661572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:23.662066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:23.662827 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:23.663270 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:23.692765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cb9ef844-6d26-4beb-9cc4-5226d82ae5fb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043576 Jul 29 13:22:23.693313 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 966/1905] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:22:24.705529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:24.707735 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:24.714793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:24.715246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:24.716016 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:24.716465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:24.745913 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0e72edcb-aefe-41a4-a815-521398e2ccf7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044337 Jul 29 13:22:24.746461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 940/1906] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:25.759205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:25.761283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:25.767314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:25.767765 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:25.768531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:25.768969 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:25.797739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fcb80409-599e-4285-9326-31bd1efe02aa tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043562 Jul 29 13:22:25.798310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 967/1907] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:25 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:26.810153 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:26.812347 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:26.818750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:26.819207 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:26.820509 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:26.820964 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:26.852159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-aa6cb178-bf8a-4092-b801-6b415a85fac7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046044 Jul 29 13:22:26.852714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 941/1908] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:27.864791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:27.867472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:27.874296 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:27.874749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:27.875512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:27.875981 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:27.907101 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-daa7f375-66d1-47b9-944e-0756d73c17c6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046369 Jul 29 13:22:27.907645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 968/1909] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:28.920353 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:28.922528 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:28.929743 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:28.930220 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:28.930979 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:28.931415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:28.960395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-937cc859-2c5e-49e8-84ed-b7650ad8e43d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044005 Jul 29 13:22:28.960943 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 942/1910] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:29.972760 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:29.974885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:29.982063 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:29.982516 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:29.983276 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:29.983714 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:30.012513 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4131b9bd-30a6-401a-b7a4-4afea31438f0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043783 Jul 29 13:22:30.013052 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 969/1911] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:31.025181 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:31.027352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:31.033891 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:31.034351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:31.035176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:31.035616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:31.065111 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c2fea2bb-d57e-417b-b085-338b883d1eb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044223 Jul 29 13:22:31.065663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 943/1912] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:32.079939 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:32.082151 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:32.089563 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:32.090048 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:32.090863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:32.091298 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:32.126212 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-51f94901-2db2-4b04-b882-f20be7741f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051216 Jul 29 13:22:32.126792 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 970/1913] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:33.139134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:33.141251 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:33.147706 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:33.148157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:33.148914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:33.149351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:33.177587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b436e311-562f-426a-b401-84f7a44491a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042387 Jul 29 13:22:33.178162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 944/1914] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:33.315340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:22:33.315493 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:22:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:22:34.190274 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:34.192367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:34.199395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:34.199834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:34.200614 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:34.201041 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:34.229595 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9fa75378-b0f8-4470-8e2e-fee4fd9e78a9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043308 Jul 29 13:22:34.230166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 971/1915] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:35.241005 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:35.243443 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:35.250522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:35.250977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:35.251729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:35.252165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:35.280752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-6991b88a-87ea-4019-88e7-7cec1cfd9636 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043752 Jul 29 13:22:35.281302 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 945/1916] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:36.293363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:36.295433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:36.297739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:36.303343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:36.303793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:36.304557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:36.304998 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:36.308821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:36.334442 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-48390b41-649e-4483-90fc-c97874e44678 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045739 Jul 29 13:22:36.334990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 972/1917] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:37.349133 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:37.351355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:37.353783 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:37.359421 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:37.359878 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:37.360654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:37.361097 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:37.364729 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:22:37.391342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2c71a210-5a6d-4107-8ec4-800a7ac87d13 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046194 Jul 29 13:22:37.391910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 946/1918] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:38.403932 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:38.406262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:38.413283 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:38.413766 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:38.414589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:38.415040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:38.446214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-51be3bc2-3d9a-4f13-9931-41f461248e92 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046397 Jul 29 13:22:38.446779 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 973/1919] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:39.459079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:39.461303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:39.468123 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:39.468578 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:39.469346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:39.469790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:39.500077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-02673257-cd05-42c1-b8e4-8e94626cd68f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045256 Jul 29 13:22:39.500626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 947/1920] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:40.512834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:40.514934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:40.521523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:40.522008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:40.522762 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:40.523190 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:40.552346 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f85bbf84-7a13-470b-9c46-b80f24ea033a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043738 Jul 29 13:22:40.552917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 974/1921] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:41.565709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:41.567952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:41.574474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:41.574926 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:41.576325 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:41.576761 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:41.606289 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cd46a9e0-c305-4180-88bf-a85b497c4dfe tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044492 Jul 29 13:22:41.606842 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 948/1922] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:42.618599 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:42.620749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:42.627921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:42.628631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:42.629402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:42.629862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:42.659420 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-fd05020a-5cea-420d-b013-9e4c56d04576 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045012 Jul 29 13:22:42.659973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 975/1923] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:43.671603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:43.673777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:43.680465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:43.680911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:43.681719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:43.682190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:43.712256 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d80aabc1-8491-4921-b6ab-96d42f1c656c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045159 Jul 29 13:22:43.712911 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 949/1924] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:43 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:44.724782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:44.726959 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:44.733573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:44.734065 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:44.734869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:44.735343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:44.765770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bf02bb9e-1876-4676-bf07-dfe89d1e5179 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045088 Jul 29 13:22:44.766438 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 976/1925] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:45.779287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:45.781458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:45.788219 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:45.788708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:45.789512 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:45.789992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:45.823101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-94c8d4f6-0d32-4a0d-aebc-c5e90e14fbab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046726 Jul 29 13:22:45.823708 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 950/1926] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:46.838847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:46.841015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:46.847491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:46.847943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:46.848707 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:46.849146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:46.878446 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-49554a77-8931-4bbd-8f2f-498e35b1c0bb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043629 Jul 29 13:22:46.878987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 977/1927] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:47.890395 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:47.892566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:47.898972 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:47.899436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:47.900182 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:47.900616 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:47.930602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9c54ec35-07c5-4287-a0d3-f090611ef87c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044406 Jul 29 13:22:47.931190 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 951/1928] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:48.942095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:48.944250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:48.950816 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:48.951269 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:48.952026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:48.952461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:48.981635 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9062bd75-6009-4c4c-bb18-700c350e628a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043554 Jul 29 13:22:48.982205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 978/1929] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:22:49.995217 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:49.997281 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:50.004342 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:50.004789 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:50.005549 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:50.006017 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:50.036586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9ef412f0-3d6a-443d-9e2d-7e0b931eb669 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045692 Jul 29 13:22:50.037149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 952/1930] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:51.281214 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:51.283357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:51.289206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:51.289650 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:51.290440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:51.290872 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:51.319557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c25a4f55-a08c-412f-ac50-78a8d37af1b4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.274889 Jul 29 13:22:51.320094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 979/1931] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:52.333025 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:52.335237 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:52.341760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:52.342251 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:52.343021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:52.343465 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:52.372781 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-135e2b8b-3835-4cc2-a15d-9dcd2f000a8e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044848 Jul 29 13:22:52.373935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 953/1932] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:53.385656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:53.387820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:53.394785 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:53.395244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:53.396008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:53.396449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:53.426213 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-a46ff219-a740-4511-b276-0ce4f819d99f tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044527 Jul 29 13:22:53.426770 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 980/1933] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:54.438206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:54.440268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:54.447049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:54.447506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:54.448270 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:54.448712 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:54.477726 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b04a4672-5dc1-46fc-90da-d22b01fc9eb7 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043611 Jul 29 13:22:54.478296 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 954/1934] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:54 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:55.492336 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:55.494808 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:55.500809 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:55.501266 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:55.502070 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:55.502511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:55.532176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b3e9728-58b5-470a-8b53-e999e73f142d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043970 Jul 29 13:22:55.532721 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 981/1935] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:56.544719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:56.547518 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:56.553833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:56.554471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:56.555139 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:56.555619 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:56.585474 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-78567b08-fa6f-43b2-b859-a1d4aced6fb4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045014 Jul 29 13:22:56.586065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 955/1936] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:57.598061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:57.600126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:57.606644 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:57.607100 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:57.608387 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:57.608830 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:57.639817 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-62d3ffd9-4821-4e4a-b563-23ac24353616 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045848 Jul 29 13:22:57.640378 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 982/1937] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:58.652116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:58.654949 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:58.661389 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:58.661872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:58.662635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:58.663073 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:58.692070 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2a280b29-75fb-4893-9f20-4338c128d84b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043879 Jul 29 13:22:58.692613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 956/1938] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:22:59.704183 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:22:59.706440 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:22:59.713075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:59.713531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:59.714332 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:22:59.714774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:22:59.745557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-94e11d21-d8a1-4ccb-bf62-e0dbb93a6dc5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045556 Jul 29 13:22:59.746135 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 983/1939] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:22:59 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:00.757927 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:00.760099 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:00.766603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:00.767074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:00.767821 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:00.768255 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:00.797124 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c41a489a-4268-4e59-8d7f-7a933c4d5c66 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043165 Jul 29 13:23:00.797673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 957/1940] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:00 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:01.808626 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:01.811285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:01.817709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:01.818186 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:01.818943 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:01.819374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:01.848205 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8ba39a3e-c8ba-4e75-b599-59beec9bec14 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043562 Jul 29 13:23:01.848742 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 984/1941] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:02.861736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:02.864286 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:02.871076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:02.871526 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:02.872815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:02.873485 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:02.910663 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a0cf9139-2daa-4ca0-bf4e-9329a8bcd13d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053662 Jul 29 13:23:02.911149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 958/1942] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:02 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:03.922873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:03.924999 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:03.931486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:03.931942 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:03.932703 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:03.933141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:03.962865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bb6b94a5-d6e5-4f6d-a243-95452ee76f95 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044020 Jul 29 13:23:03.963415 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 985/1943] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:03 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:04.974533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:04.976654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:04.983151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:04.983601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:04.984361 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:04.984797 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:05.014601 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1fe6a0fb-581f-4d22-a197-a44e03a3b59b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044059 Jul 29 13:23:05.015148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 959/1944] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:04 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:06.026464 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:06.028613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:06.035766 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:06.036222 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:06.036987 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:06.037430 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:06.066263 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0219890d-124c-43fc-9e2a-4c384bd0a529 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043797 Jul 29 13:23:06.067084 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 986/1945] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:06 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:07.078883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:07.081094 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:07.087595 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:07.088043 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:07.088801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:07.089233 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:07.119654 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-82f3113e-86f7-4066-a4a1-292e2bd833df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044763 Jul 29 13:23:07.120212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 960/1946] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:07 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:08.133182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:08.135410 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:08.137848 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:08.143209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:08.143655 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:08.144417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:08.144877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:08.148593 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:08.174146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cedb2ebf-5a6c-411c-a7ee-fbd055fd8858 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045781 Jul 29 13:23:08.174697 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 987/1947] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:08 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:09.186715 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:09.188864 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:09.191155 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:09.197163 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:09.197615 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:09.198415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:09.198851 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:09.201292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:09.228764 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b76a464b-24ac-47ec-9db4-e8bd8f6ff440 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046021 Jul 29 13:23:09.229319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 961/1948] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:09 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:10.241419 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:10.243821 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:10.251122 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:10.251572 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:10.252337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:10.252778 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:10.281443 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ec8ce4e2-5688-4b03-b84f-36f59679bef9 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044008 Jul 29 13:23:10.282019 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 988/1949] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:10 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:11.293575 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:11.295776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:11.302467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:11.302921 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:11.303673 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:11.304105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:11.332959 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a8c287b8-8f45-48c3-ba91-f9c8f3730ff1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043334 Jul 29 13:23:11.333500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 962/1950] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:11 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:12.345789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:12.347955 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:12.354469 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:12.354925 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:12.355747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:12.356196 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:12.386766 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-53414c6b-4bce-4194-90de-03317c297d49 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045456 Jul 29 13:23:12.387253 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 989/1951] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:12 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:13.399317 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:13.401386 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:13.407824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:13.408276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:13.409037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:13.409477 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:13.438795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0746dc56-d647-4cb2-9373-82a496f0c3e1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043499 Jul 29 13:23:13.439369 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 963/1952] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:13 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:14.451945 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:14.454027 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:14.461096 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:14.461551 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:14.462350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:14.462788 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:14.491604 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9c847ab3-d384-4252-8d85-b99c74950c38 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043770 Jul 29 13:23:14.492162 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 990/1953] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:14 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:15.504277 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:15.506366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:15.512753 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:15.513204 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:15.514049 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:15.514497 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:15.554053 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-67e82bd0-c59f-4904-9c4d-b20404d68710 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053807 Jul 29 13:23:15.554608 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 964/1954] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:15 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:16.567230 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:16.569379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:16.576023 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:16.576481 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:16.577256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:16.577696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:16.612080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-1a53a244-0acf-49f5-b1f9-42b395f2c792 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048825 Jul 29 13:23:16.612642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 991/1955] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:16 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:17.624933 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:17.627092 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:17.634063 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:17.634520 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:17.635288 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:17.635731 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:17.664804 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2756f4b6-4c45-4a1b-a5a9-7dadc575fcc4 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043825 Jul 29 13:23:17.665352 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 965/1956] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:17 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:18.676997 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:18.679197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:18.685612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:18.686113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:18.686894 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:18.687328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:18.716348 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ce7b1f2f-3b92-4a8e-ba82-02624d6773df tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043313 Jul 29 13:23:18.716893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 992/1957] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:18 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:19.728570 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:19.730744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:19.737186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:19.738266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:19.739029 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:19.739464 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:19.768628 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f79a7090-bef6-4a30-b401-22071368b615 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044025 Jul 29 13:23:19.769213 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 966/1958] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:19 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:20.780641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:20.782828 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:20.789254 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:20.789710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:20.790498 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:20.790936 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:20.820880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b6f996b7-e209-458f-9da7-869736de26eb tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044203 Jul 29 13:23:20.821436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 993/1959] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:20 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:21.832948 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:21.835199 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:21.841814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:21.842305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:21.843076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:21.843515 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:21.874251 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-181af860-d7ec-42c5-ad2c-57a4c8bbc60d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045332 Jul 29 13:23:21.874802 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 967/1960] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:21 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:22.887486 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:22.889645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:22.896393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:22.896847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:22.897615 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:22.898080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:22.927500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7d52a47d-ce0f-4086-9c9d-43dd7fa67f96 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044116 Jul 29 13:23:22.928064 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 994/1961] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:22 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:23.940744 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:23.942965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:23.949548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:23.950040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:23.950850 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:23.951293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:23.987472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4761e18e-4f9c-4667-83b0-4d1fccaf6719 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050796 Jul 29 13:23:23.988040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 968/1962] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:23 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:25.000941 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:25.003227 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:25.009690 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:25.010202 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:25.010960 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:25.011448 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:25.040777 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6e749eaa-38b5-4d26-9fdd-7a7d333150a8 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044066 Jul 29 13:23:25.042005 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 995/1963] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:24 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:26.054159 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:26.056324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:26.063072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:26.063525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:26.064287 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:26.064723 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:26.093925 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e9908a77-07ff-42d4-8d72-949dd48ac9d1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043904 Jul 29 13:23:26.094471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 969/1964] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:26 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:27.106193 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:27.108417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:27.114983 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:27.115434 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:27.116212 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:27.116657 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:27.147265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-bde30110-f619-40cd-bf6d-d4f53216ceb2 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045028 Jul 29 13:23:27.147826 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 996/1965] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:27 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:28.161446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:28.164149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:28.172548 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:28.173108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:28.174112 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:28.174639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:28.211211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b841f8b2-772a-4e77-b654-1c2ad1b48a25 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054657 Jul 29 13:23:28.211763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 970/1966] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:28 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:29.223380 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:29.225709 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:29.232666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:29.233123 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:29.234725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:29.234725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:29.270541 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-db753726-bf22-4b8c-ba27-398cad483400 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051133 Jul 29 13:23:29.271099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 997/1967] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:29 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:30.283109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:30.285334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:30.292437 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:30.292879 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:30.293656 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:30.294109 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:30.323300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-faf0641e-13b2-4cb5-8091-77492edab6ab tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044239 Jul 29 13:23:30.323865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 971/1968] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:30 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:31.335880 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:31.338272 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:31.345333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:31.345893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:31.346701 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:31.347159 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:31.379617 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4537579d-3e7b-48c8-a77b-86b0769ea69c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048077 Jul 29 13:23:31.380182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 998/1969] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:31 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:32.391740 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:32.393791 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:32.400388 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:32.400835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:32.401587 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:32.402052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:32.431127 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-80873677-eadb-4f62-83d4-b84287a8a10e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043882 Jul 29 13:23:32.431667 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 972/1970] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:32 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:33.443864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:33.445974 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:33.452361 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:33.452805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:33.453555 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:33.454016 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:33.483121 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-76d9e967-b5b8-4a5e-9c90-68e14a30d184 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042771 Jul 29 13:23:33.483660 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 999/1971] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:33 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:34.495482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:34.497543 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:34.504584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:34.505040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:34.505798 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:34.506266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:34.537467 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-56c5a485-c9f6-4b66-a365-cf361d60a530 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046267 Jul 29 13:23:34.538062 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 973/1972] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:34 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:35.550050 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:35.552120 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:35.558755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:35.559209 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:35.559995 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:35.560433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:35.590199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-946665d9-6955-43e8-80bc-7d4b0f7a894b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044222 Jul 29 13:23:35.590805 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1000/1973] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:35 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:36.602714 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:36.604894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:36.611268 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:36.611719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:36.612478 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:36.612919 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:36.642105 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c7fd52f2-29bc-4a29-8a19-5cd7ff5c256b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043319 Jul 29 13:23:36.642658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 974/1974] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:36 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:37.654250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:37.656905 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:37.663627 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:37.664075 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:37.664863 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:37.665294 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:37.694570 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f70a75b8-ec61-49b8-b056-cc7abf6280e3 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044356 Jul 29 13:23:37.695151 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1001/1975] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:37 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:38.706503 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:38.708642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:38.715177 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:38.715623 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:38.716378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:38.716807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:38.746973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-0f16c1d4-4f0e-4fea-aac6-e80311760251 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044962 Jul 29 13:23:38.747534 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 975/1976] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:38 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:39.759731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:39.761921 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:39.764200 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=30 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:39.770137 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:39.770613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:39.771362 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:39.771801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:39.775637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=90 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:39.802088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b6e08409-3df5-4e89-a01c-df2ff85fdc2e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046298 Jul 29 13:23:39.802641 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1002/1977] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:39 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:40.814463 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:40.816752 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:40.819170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=30 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:40.824749 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:40.825203 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:40.826008 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:40.826455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:40.830121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=90 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:23:40.857130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5bc07d7d-e702-4904-badf-b3a29074c65b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046727 Jul 29 13:23:40.857695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 976/1978] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:40 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:41.870247 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:41.872385 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:41.879589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:41.880040 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:41.880800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:41.881238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:41.909692 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6629565f-966e-444d-86f7-da9804274a4d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043768 Jul 29 13:23:41.910265 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1003/1979] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:41 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:42.922228 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:42.924300 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:42.930815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:42.931265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:42.932022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:42.932459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:43.116406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-5a7aa2c0-47db-4089-bc5c-06fb89bcbfaf tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.198215 Jul 29 13:23:43.116977 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 977/1980] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:42 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:44.129502 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:44.131682 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:44.138184 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:44.138640 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:44.139432 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:44.139875 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:44.169372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-aa6afbaa-e4a8-43ee-b78a-ec8efa050cd5 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044396 Jul 29 13:23:44.169935 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1004/1981] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:44 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:45.181620 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:45.183837 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:45.190339 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:45.191319 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:45.192087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:45.192527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:45.222483 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c226bf0c-ab49-4bdf-a7d9-ca8486aaf760 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044613 Jul 29 13:23:45.223115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 978/1982] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:45 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:46.235241 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:46.237392 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:46.244495 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:46.244938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:46.245689 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:46.246150 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:46.274950 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-9e35e0c4-d764-46b3-a639-6f7281b03ff0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043692 Jul 29 13:23:46.275487 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1005/1983] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:46 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:47.288027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:47.290311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:47.296828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:47.297284 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:47.298082 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:47.298529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:47.327778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-57911244-6f2a-4ccb-811b-97fb30ab4f0c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044321 Jul 29 13:23:47.328321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 979/1984] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:47 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:48.340739 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:48.343039 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:48.350032 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:48.350488 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:48.351255 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:48.351693 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:48.383143 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0e2de6a2-aace-4971-8bca-cf82581b975a tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046293 Jul 29 13:23:48.383893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1006/1985] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:48 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:49.395542 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:49.397579 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:49.404010 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:49.404458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:49.405208 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:49.405640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:49.434101 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9595bc75-94cf-47a3-bdbc-b1d1174b02ac tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042605 Jul 29 13:23:49.434639 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 980/1986] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:49 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:50.446113 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:50.448188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:50.454612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:50.455051 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:50.455799 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:50.456243 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:50.484835 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-532c5933-b41c-4e80-af39-5538bbaf33ad tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042772 Jul 29 13:23:50.485375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1007/1987] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:50 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:51.497424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:23:51.499533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:51.506782 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:51.507241 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:51.508011 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:51.508455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:51.537778 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-740fe6f0-9b53-4f86-ad20-e799a6fc058e tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044718 Jul 29 13:23:51.538487 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 981/1988] 10.222.0.66 () {58 vars in 1302 bytes} [Fri Jul 29 13:23:51 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:23:52.549643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:23:52.552350 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:23:52.558918 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:52.559375 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:52.560141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:23:52.560582 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:23:52.624573 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-00e97443-1087-4927-a495-cb759d849f19 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/action" status: 200 len: 41364 microversion: 2.1 time: 0.078825 Jul 29 13:23:52.625206 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1008/1989] 10.222.0.66 () {60 vars in 1278 bytes} [Fri Jul 29 13:23:52 2022] POST /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259/action => generated 41364 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 13:25:08.672525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:25:08.673121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:25:28.186133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:25:28.186634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:25:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:25:31.538717 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:25:31.539293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:25:53.323939 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:25:53.324507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:27:09.138097 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:27:09.138609 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:28:28.682189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:28:28.682672 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:28:48.194105 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:28:48.194538 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:28:51.546472 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:28:51.546978 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:28:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:28:57.614560 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1444592862", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "networks": [{"uuid": "2e97735b-5a55-491d-b742-47524d02866b"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:28:57.623365 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76004ffb-65f1-4920-bae8-fe0ef9fac084] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 13:28:57.623883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=11 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:28:57.624709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=35 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:28:57.850235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] validate_networks() for [('2e97735b-5a55-491d-b742-47524d02866b', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 13:28:58.248801 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 13:28:58.249231 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 13:28:58.249711 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 13:28:58.250162 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 13:28:58.250586 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 13:28:58.262066 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:28:58.262525 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:28:58.263343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:28:58.263785 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:28:58.287660 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Getting quotas for project 1c2c62fd3f254d4f89d36d71df10b659. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 13:28:58.291763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Getting quotas for user e6fa32cc731743878ad4e45dba8d362d and project 1c2c62fd3f254d4f89d36d71df10b659. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 13:28:58.312368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 13:28:58.314728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 13:28:58.360269 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9c50f3c5-8f40-4bdc-8895-cef7cd53d909 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750775 Jul 29 13:28:58.360894 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 982/1990] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 13:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 13:28:58.370290 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR oslo.messaging._drivers.impl_rabbit [-] [352bdc36-01b7-488f-81fb-dca14cfc664d] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 13:28:58.371244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=13 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:28:58.372197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=39 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:28:58.376512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-c3c7fb8a-0e31-4980-899b-e5ee5ae73d1c tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:28:58.377250 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-c3c7fb8a-0e31-4980-899b-e5ee5ae73d1c tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:28:58.485406 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-c3c7fb8a-0e31-4980-899b-e5ee5ae73d1c tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:28:58.492891 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-c3c7fb8a-0e31-4980-899b-e5ee5ae73d1c tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1214 microversion: 2.1 time: 0.124904 Jul 29 13:28:58.493457 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1009/1991] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:28:58 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:28:59.515496 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:28:59.516107 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:28:59.523635 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:28:59.524165 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:28:59.524861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:28:59.525299 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:28:59.531122 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] [76004ffb-65f1-4920-bae8-fe0ef9fac084] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 39392. Jul 29 13:28:59.596653 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:28:59.606022 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-2bfd7039-abbd-4930-986b-2373fee13f28 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1272 microversion: 2.1 time: 0.095285 Jul 29 13:28:59.606884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 983/1992] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:28:59 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:00.629170 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:00.629790 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:00.641840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] [352bdc36-01b7-488f-81fb-dca14cfc664d] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 39400. Jul 29 13:29:00.644433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:00.644722 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:00.645508 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:00.645980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:00.744558 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cc7bf4-9276-472b-89c3-e0a84b2a2a08", "tag": "7c69bc18-268b-4cfd-9b6b-92337296aef0"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:00.755626 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:00.756170 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:00.768375 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] Creating event network-changed:7c69bc18-268b-4cfd-9b6b-92337296aef0 for instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 on hv-cinder-81914 Jul 29 13:29:00.771707 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR oslo.messaging._drivers.impl_rabbit [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] [d4fdc7d8-bb51-4bb0-b64a-f61484df1875] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 13:29:00.817195 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:00.825576 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0b95979b-f5b8-41d4-8661-79a88bcb290f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1314 microversion: 2.1 time: 0.200601 Jul 29 13:29:00.826532 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1010/1993] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:00 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:01.796445 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] [d4fdc7d8-bb51-4bb0-b64a-f61484df1875] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 39408. Jul 29 13:29:01.799929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-44567a42-415f-49d4-9d3f-474340022c27 req-26e97d1c-e82b-453d-9037-2f1a5816157c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.128142 Jul 29 13:29:01.800527 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 984/1994] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:29:01.846328 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:01.846973 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:01.853411 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:01.853879 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:01.854638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:01.855066 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:01.981414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:01.988893 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-31f552e3-2d06-43eb-833d-1c1cc07481eb tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1314 microversion: 2.1 time: 0.146390 Jul 29 13:29:01.989462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1011/1995] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:01 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:03.010719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:03.011330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:03.017481 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:03.017969 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:03.019379 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:03.019814 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:03.150166 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:03.157645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d4d74ba4-9abd-43ea-af31-7af24c45fb78 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1314 microversion: 2.1 time: 0.151725 Jul 29 13:29:03.158245 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 985/1996] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:03 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:03.649597 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:29:03.650087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:29:04.179382 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:04.179993 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:04.186455 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:04.186904 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:04.187656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:04.188091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:04.317607 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:04.325025 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-63c702fd-7896-4456-ad7b-5625aca0e18d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1314 microversion: 2.1 time: 0.150210 Jul 29 13:29:04.325587 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1012/1997] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:04 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:05.296275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-89e67d60-dfcb-41fe-b5ec-d00000c1d549 req-f62731de-4738-4674-849c-6c02c6a56dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cc7bf4-9276-472b-89c3-e0a84b2a2a08", "name": "network-vif-plugged", "status": "completed", "tag": "7c69bc18-268b-4cfd-9b6b-92337296aef0"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:05.307035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-89e67d60-dfcb-41fe-b5ec-d00000c1d549 req-f62731de-4738-4674-849c-6c02c6a56dcc service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:05.307035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-89e67d60-dfcb-41fe-b5ec-d00000c1d549 req-f62731de-4738-4674-849c-6c02c6a56dcc service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:05.318057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-89e67d60-dfcb-41fe-b5ec-d00000c1d549 req-f62731de-4738-4674-849c-6c02c6a56dcc service nova] Creating event network-vif-plugged:7c69bc18-268b-4cfd-9b6b-92337296aef0 for instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 on hv-cinder-81914 Jul 29 13:29:05.323119 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-89e67d60-dfcb-41fe-b5ec-d00000c1d549 req-f62731de-4738-4674-849c-6c02c6a56dcc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090282 Jul 29 13:29:05.323704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 986/1998] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:29:05.345699 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:05.346353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:05.353395 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:05.353871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:05.354653 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:05.355094 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:05.490171 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:05.498110 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f3657f42-5ece-4185-85bf-51848d504666 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1314 microversion: 2.1 time: 0.156241 Jul 29 13:29:05.498693 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1013/1999] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:05 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:06.520057 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:06.520671 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:06.526896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:06.527351 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:06.528115 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:06.528550 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:06.670098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:06.678077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-4e445612-62ed-4c1b-bb8d-c6a8ef4e41bc tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1498 microversion: 2.1 time: 0.162782 Jul 29 13:29:06.678640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 987/2000] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:06 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:07.078856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:07.079354 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:07.086696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:07.087146 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:07.087913 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:07.088353 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:07.114519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 13:29:07.191946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-70f23ce1-9b2d-4622-90e9-e294eb0047b9 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "DELETE /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 204 len: 0 microversion: 2.1 time: 0.116332 Jul 29 13:29:07.192622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1014/2001] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:29:07 2022] DELETE /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 13:29:07.201679 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:07.202321 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:07.209113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:07.209564 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:07.210366 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:07.210807 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:07.354867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:07.362276 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-10d14167-8d95-42d7-864c-d8c783ab49d7 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1504 microversion: 2.1 time: 0.164370 Jul 29 13:29:07.362836 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 988/2002] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:07 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:08.384245 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:08.384878 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:08.391433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:08.391889 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:08.392659 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:08.393099 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:08.489750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:08.522317 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:08.529769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-f7ef710c-8759-49b9-ab72-97ac29232f81 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 200 len: 1504 microversion: 2.1 time: 0.149942 Jul 29 13:29:08.530683 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1015/2003] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:08 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:08.959195 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-223824a0-d29a-45db-bfb6-3a8f9e9f42c7 req-e8ccb4f9-b560-43ee-ae3f-ab098863f2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cc7bf4-9276-472b-89c3-e0a84b2a2a08", "name": "network-vif-deleted", "tag": "7c69bc18-268b-4cfd-9b6b-92337296aef0"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:08.964490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:08.965134 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:08.971445 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-223824a0-d29a-45db-bfb6-3a8f9e9f42c7 req-e8ccb4f9-b560-43ee-ae3f-ab098863f2d9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:08.972566 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-223824a0-d29a-45db-bfb6-3a8f9e9f42c7 req-e8ccb4f9-b560-43ee-ae3f-ab098863f2d9 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:08.983920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-223824a0-d29a-45db-bfb6-3a8f9e9f42c7 req-e8ccb4f9-b560-43ee-ae3f-ab098863f2d9 service nova] Creating event network-vif-deleted:7c69bc18-268b-4cfd-9b6b-92337296aef0 for instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 on hv-cinder-81914 Jul 29 13:29:08.988951 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-223824a0-d29a-45db-bfb6-3a8f9e9f42c7 req-e8ccb4f9-b560-43ee-ae3f-ab098863f2d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033940 Jul 29 13:29:08.989559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 989/2004] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:29:09.551277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:09.551835 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 29cc7bf4-9276-472b-89c3-e0a84b2a2a08] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:09.558314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:09.558771 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:09.559557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:09.560002 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:09.573761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] HTTP exception thrown: Instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 could not be found. Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Request method failure captured: Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 HTTP/1.1 Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi4-CYNh7JYjObU6NiEK9IRRcKBncw_mEP7e7J1BpIBRJmCAC1vbiJmXIDFqIEzKXg7JuVmwCDcHChU21Q3m3UFTk0QiTtdKVeS2vOqYpdABGgbBq1vEdvLgHMYuQRhBwxlUWo80fxSzVNWJtYBXen5nYmQS1XU1S39sdS8fqiLtp1a2g Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 1c2c62fd3f254d4f89d36d71df10b659 Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-VolumesActionsTest-1052442946 Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 13:29:09.575408 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-VolumesActionsTest-1052442946 Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 1c2c62fd3f254d4f89d36d71df10b659 Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-VolumesActionsTest-1052442946 Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-VolumesActionsTest-1052442946-project Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: e6fa32cc731743878ad4e45dba8d362d Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-VolumesActionsTest-1052442946-project Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 could not be found. Jul 29 13:29:09.576666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '29cc7bf4-9276-472b-89c3-e0a84b2a2a08'} Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 could not be found. Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:29:09.580160 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 could not be found. Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 could not be found. Jul 29 13:29:09.582081 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:29:09.582954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Returning 404 to user: Instance 29cc7bf4-9276-472b-89c3-e0a84b2a2a08 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:29:09.582954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3c99a9bc-16c2-4d71-9fe3-23960d35328e tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08" status: 404 len: 111 microversion: 2.1 time: 0.029487 Jul 29 13:29:09.582954 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1016/2005] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:09 2022] GET /compute/v2.1/servers/29cc7bf4-9276-472b-89c3-e0a84b2a2a08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:29:09.628309 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1197937975", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "networks": [{"uuid": "2e97735b-5a55-491d-b742-47524d02866b"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:09.680349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] validate_networks() for [('2e97735b-5a55-491d-b742-47524d02866b', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 13:29:10.024414 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 13:29:10.024936 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 13:29:10.025344 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 13:29:10.025760 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 13:29:10.026206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 13:29:10.035034 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:10.035486 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:10.036292 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:10.036736 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:10.054174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Getting quotas for project 1c2c62fd3f254d4f89d36d71df10b659. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 13:29:10.058069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Getting quotas for user e6fa32cc731743878ad4e45dba8d362d and project 1c2c62fd3f254d4f89d36d71df10b659. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 13:29:10.069929 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 13:29:10.072343 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 13:29:10.118072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-c89960e4-5071-411f-b51e-a47bc4a24a10 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494602 Jul 29 13:29:10.118915 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 990/2006] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 13:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 13:29:10.129917 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-6fb0d234-f8ab-4402-b652-09d62c721e7f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:10.130531 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-6fb0d234-f8ab-4402-b652-09d62c721e7f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:10.185552 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-6fb0d234-f8ab-4402-b652-09d62c721e7f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:10.192239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-6fb0d234-f8ab-4402-b652-09d62c721e7f tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1214 microversion: 2.1 time: 0.066223 Jul 29 13:29:10.192800 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1017/2007] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:10 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:11.214085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:11.214820 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:11.225613 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:11.226098 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:11.226884 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:11.227330 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:11.300918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:11.308455 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-a84b701a-e770-4524-8303-e1328942d750 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1272 microversion: 2.1 time: 0.099187 Jul 29 13:29:11.309025 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 991/2008] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:11 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:29:12.307864 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-aad344e3-ae0e-485f-8488-9701d2ef657f req-aa027dcd-7a4c-4a3e-b97a-34edc6b12958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3501a102-1ae1-4a25-b644-2c8ea6e100cb", "tag": "0064e4b3-7a0a-4430-a680-ba07a6e4be35"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:12.319367 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-aad344e3-ae0e-485f-8488-9701d2ef657f req-aa027dcd-7a4c-4a3e-b97a-34edc6b12958 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:12.319797 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-aad344e3-ae0e-485f-8488-9701d2ef657f req-aa027dcd-7a4c-4a3e-b97a-34edc6b12958 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:12.333713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-aad344e3-ae0e-485f-8488-9701d2ef657f req-aa027dcd-7a4c-4a3e-b97a-34edc6b12958 service nova] Creating event network-changed:0064e4b3-7a0a-4430-a680-ba07a6e4be35 for instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb on hv-cinder-81914 Jul 29 13:29:12.338871 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-aad344e3-ae0e-485f-8488-9701d2ef657f req-aa027dcd-7a4c-4a3e-b97a-34edc6b12958 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035394 Jul 29 13:29:12.339716 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1018/2009] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 13:29:12.340019 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:12.340796 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:12.347917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:12.348584 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:12.349591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:12.350141 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:12.560157 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:12.568074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-9a939be2-a25f-468d-b086-2ef6bdc10149 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1314 microversion: 2.1 time: 0.242177 Jul 29 13:29:12.568645 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 992/2010] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:12 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:13.589496 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:13.590239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:13.596467 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:13.596924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:13.597698 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:13.598167 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:13.730820 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:13.738947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3529c5a9-3428-4f6c-94bd-584e590c6987 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1314 microversion: 2.1 time: 0.154168 Jul 29 13:29:13.739624 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1019/2011] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:13 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:29:14.759959 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:14.760610 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:14.767116 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:14.767569 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:14.768334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:14.769370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:14.895350 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:14.903640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-86ddf0b1-3a13-4d02-9e88-77caafc665d5 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1314 microversion: 2.1 time: 0.147564 Jul 29 13:29:14.904263 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 993/2012] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:14 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:15.924638 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:15.925261 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:15.931892 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:15.932347 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:15.933117 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:15.933557 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:16.060622 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:16.068669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-18f8fd5f-97ad-4aa2-99a5-4240a7115789 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1314 microversion: 2.1 time: 0.148085 Jul 29 13:29:16.069238 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1020/2013] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:15 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:17.090812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:17.091430 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:17.098045 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:17.098500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:17.099266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:17.099713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:17.229986 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:17.238079 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b1bca9b4-51c6-41ce-9b34-cb0df4f17333 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1314 microversion: 2.1 time: 0.150525 Jul 29 13:29:17.238649 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 994/2014] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:17 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:17.314079 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-166fe23d-06c5-4ea8-9692-8ecacb0e17d4 req-c2488061-13ba-4d4b-a50b-b47316122846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3501a102-1ae1-4a25-b644-2c8ea6e100cb", "name": "network-vif-plugged", "status": "completed", "tag": "0064e4b3-7a0a-4430-a680-ba07a6e4be35"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:17.326424 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-166fe23d-06c5-4ea8-9692-8ecacb0e17d4 req-c2488061-13ba-4d4b-a50b-b47316122846 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:17.326877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-166fe23d-06c5-4ea8-9692-8ecacb0e17d4 req-c2488061-13ba-4d4b-a50b-b47316122846 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:17.338447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-166fe23d-06c5-4ea8-9692-8ecacb0e17d4 req-c2488061-13ba-4d4b-a50b-b47316122846 service nova] Creating event network-vif-plugged:0064e4b3-7a0a-4430-a680-ba07a6e4be35 for instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb on hv-cinder-81914 Jul 29 13:29:17.343374 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-166fe23d-06c5-4ea8-9692-8ecacb0e17d4 req-c2488061-13ba-4d4b-a50b-b47316122846 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032981 Jul 29 13:29:17.343909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1021/2015] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:29:18.259581 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:18.260197 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:18.266694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:18.267151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:18.267920 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:18.268866 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:18.392896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:18.401131 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7013c68c-ba15-4bf1-8b4e-3d2a6cbfd81b tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1314 microversion: 2.1 time: 0.145444 Jul 29 13:29:18.401697 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 995/2016] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:18 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:19.422178 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:19.422882 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:19.430427 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:19.430881 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:19.431645 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:19.432088 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:19.567371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:19.575584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-578606e7-73a2-4db9-baba-8f9083cfcc07 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1499 microversion: 2.1 time: 0.157693 Jul 29 13:29:19.576157 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1022/2017] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:19 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:20.009459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:20.010003 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:20.016492 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:20.016946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:20.017713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:20.018172 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:20.042790 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 13:29:20.045490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:20.068735 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:20.121867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-73f114de-f99f-4088-8ac8-4147b23c4036 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 204 len: 0 microversion: 2.1 time: 0.115488 Jul 29 13:29:20.123323 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 996/2018] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:29:20 2022] DELETE /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 13:29:20.131500 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:20.132112 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:20.138129 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:20.138580 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:20.139343 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:20.139793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:20.190631 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:20.269985 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:20.277447 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-767c1e0e-3713-4804-9b94-8713dba55e3a tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1505 microversion: 2.1 time: 0.150353 Jul 29 13:29:20.278049 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1023/2019] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:20 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:21.298675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:21.299356 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:21.305793 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:21.306275 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:21.307026 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:21.307456 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:21.466248 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa32cc731743878ad4e45dba8d362d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2c62fd3f254d4f89d36d71df10b659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:21.474100 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-44e2a65b-d008-4e3c-bb84-05710d11720d tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 200 len: 1505 microversion: 2.1 time: 0.179537 Jul 29 13:29:21.474914 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 997/2020] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:21 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:21.886364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-8b6a56e4-140f-4374-93ab-9e576c68ac5b req-48ffa7c3-7e4b-462a-99a1-163294b6fdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3501a102-1ae1-4a25-b644-2c8ea6e100cb", "name": "network-vif-deleted", "tag": "0064e4b3-7a0a-4430-a680-ba07a6e4be35"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:21.896285 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-8b6a56e4-140f-4374-93ab-9e576c68ac5b req-48ffa7c3-7e4b-462a-99a1-163294b6fdea service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:21.896735 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-8b6a56e4-140f-4374-93ab-9e576c68ac5b req-48ffa7c3-7e4b-462a-99a1-163294b6fdea service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:21.908174 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-8b6a56e4-140f-4374-93ab-9e576c68ac5b req-48ffa7c3-7e4b-462a-99a1-163294b6fdea service nova] Creating event network-vif-deleted:0064e4b3-7a0a-4430-a680-ba07a6e4be35 for instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb on hv-cinder-81914 Jul 29 13:29:21.913497 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-8b6a56e4-140f-4374-93ab-9e576c68ac5b req-48ffa7c3-7e4b-462a-99a1-163294b6fdea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 Jul 29 13:29:21.914141 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1024/2021] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:29:22.495622 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:22.496402 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] [instance: 3501a102-1ae1-4a25-b644-2c8ea6e100cb] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:22.502946 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:22.503378 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:22.504140 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:22.504603 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:22.518745 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] HTTP exception thrown: Instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb could not be found. Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Request method failure captured: Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb HTTP/1.1 Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi4-CYNh7JYjObU6NiEK9IRRcKBncw_mEP7e7J1BpIBRJmCAC1vbiJmXIDFqIEzKXg7JuVmwCDcHChU21Q3m3UFTk0QiTtdKVeS2vOqYpdABGgbBq1vEdvLgHMYuQRhBwxlUWo80fxSzVNWJtYBXen5nYmQS1XU1S39sdS8fqiLtp1a2g Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 1c2c62fd3f254d4f89d36d71df10b659 Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesActionsTest-1052442946 Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 13:29:22.520482 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c2c62fd3f254d4f89d36d71df10b659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesActionsTest-1052442946 Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 1c2c62fd3f254d4f89d36d71df10b659 Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesActionsTest-1052442946 Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesActionsTest-1052442946-project Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: e6fa32cc731743878ad4e45dba8d362d Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesActionsTest-1052442946-project Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb could not be found. Jul 29 13:29:22.521709 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '3501a102-1ae1-4a25-b644-2c8ea6e100cb'} Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb could not be found. Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:29:22.522363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb could not be found. Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb could not be found. Jul 29 13:29:22.523331 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:22.524355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] Returning 404 to user: Instance 3501a102-1ae1-4a25-b644-2c8ea6e100cb could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:29:22.524355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-794dfd17-8ae5-4d8f-a543-57fde3179b50 tempest-VolumesActionsTest-1052442946 tempest-VolumesActionsTest-1052442946-project] 10.222.0.66 "GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb" status: 404 len: 111 microversion: 2.1 time: 0.030269 Jul 29 13:29:22.524355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 998/2022] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:22 2022] GET /compute/v2.1/servers/3501a102-1ae1-4a25-b644-2c8ea6e100cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:29:52.448749 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:52.450069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:52.454330 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:52.455421 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:52.463089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:52.463556 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:52.464341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:52.464782 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:52.491364 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 13:29:52.568947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-94ceb4f1-07ab-4c7e-8a0d-58c94e98fd8c tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 204 len: 0 microversion: 2.1 time: 0.121525 Jul 29 13:29:52.569537 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1025/2023] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:29:52 2022] DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 13:29:52.577720 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:52.578376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:52.582406 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:52.583040 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:29:52.586533 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:52.587206 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:52.588192 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:52.588633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:52.744326 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:52.753209 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-e916b36e-2cb7-4622-b9bb-ef82cf354e59 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1768 microversion: 2.1 time: 0.179296 Jul 29 13:29:52.753777 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 999/2024] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:52 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1768 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:53.775287 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:53.775980 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:53.782357 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:53.782807 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:53.784069 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:53.784505 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:54.146592 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:54.155306 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-3dfe1409-d9a2-404a-8c1d-84cf7f9da083 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1768 microversion: 2.1 time: 0.384068 Jul 29 13:29:54.155934 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1026/2025] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:53 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1768 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:55.176713 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:55.177328 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:55.183835 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:55.184282 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:55.185037 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:55.185475 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:55.314562 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:55.323298 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-15a76f1e-8956-419d-abf6-71c5efd47e6d tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1768 microversion: 2.1 time: 0.150633 Jul 29 13:29:55.323866 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1000/2026] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:55 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1768 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:56.346476 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:56.347095 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:56.353669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:56.354161 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:56.354931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:56.355372 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:56.493734 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:56.502952 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-48b34439-100a-4748-ab86-b83b8d1925b6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1768 microversion: 2.1 time: 0.161095 Jul 29 13:29:56.503596 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1027/2027] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:56 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1768 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:56.743316 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-36e33650-6426-4d21-be36-6147deb3d83c req-5ec9e71c-30cd-4387-8242-a15d7ac7d440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0648f4c1-242e-4fa9-ad53-9f4d24cfe259", "name": "network-vif-deleted", "tag": "a0eea1bb-4265-4a85-be70-37e7d42b5c16"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:29:56.754340 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-36e33650-6426-4d21-be36-6147deb3d83c req-5ec9e71c-30cd-4387-8242-a15d7ac7d440 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:56.755027 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-36e33650-6426-4d21-be36-6147deb3d83c req-5ec9e71c-30cd-4387-8242-a15d7ac7d440 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:56.768211 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-36e33650-6426-4d21-be36-6147deb3d83c req-5ec9e71c-30cd-4387-8242-a15d7ac7d440 service nova] Creating event network-vif-deleted:a0eea1bb-4265-4a85-be70-37e7d42b5c16 for instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 on hv-cinder-81914 Jul 29 13:29:56.773198 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-36e33650-6426-4d21-be36-6147deb3d83c req-5ec9e71c-30cd-4387-8242-a15d7ac7d440 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033691 Jul 29 13:29:56.774018 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1001/2028] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:29:57.527134 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:57.528725 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:57.541164 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:57.541931 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:57.543197 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:57.543865 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:57.585512 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:57.586011 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:57.586679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lazy-loading 'fault' on Instance uuid 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 13:29:57.629277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f312d5c7334ccc82be17c5dfe29aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36dffd2ab1643ed939ffe87e5928187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:29:57.636201 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-599d8626-bffb-4f84-8081-25cffb77aab6 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 200 len: 1326 microversion: 2.1 time: 0.114901 Jul 29 13:29:57.637018 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1028/2029] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:57 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:29:58.659606 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:58.660502 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:29:58.667427 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:58.667889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:58.668666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:29:58.669108 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:29:58.683766 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] HTTP exception thrown: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Request method failure captured: Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 HTTP/1.1 Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49fk3Rs_iAESg1_sZjEEX-mNZC8cQ_6DqMGCvoG3aPTg7fnjR3c39A2RpB1A1uU39T7U1I8SoAisDCOTcSd09wGAeYMuoEDLyQU6Smeb4dnRaILkgIHt7Kqdisu6ZSeAjcKMUPkSUekTKOzptG06OfEL5UtXC1oJvoqWMcc49pNtaLY Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 13:29:58.685728 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 03f312d5c7334ccc82be17c5dfe29aeb Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:29:58.687295 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '0648f4c1-242e-4fa9-ad53-9f4d24cfe259'} Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:29:58.688072 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:29:58.689737 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:29:58.690719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Returning 404 to user: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:29:58.690719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fc46372e-4649-43da-97fd-28fcde92ee0b tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 404 len: 111 microversion: 2.1 time: 0.032723 Jul 29 13:29:58.690719 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1002/2030] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:29:58 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:29:58.698033 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-ace42dae-7906-410a-9288-b9002b496921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '.version_select at 0x7f74a2184af0>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:29:58.726745 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-ace42dae-7906-410a-9288-b9002b496921 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87267584" status: 202 len: 0 microversion: 2.1 time: 0.033173 Jul 29 13:29:58.727314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1029/2031] 10.222.0.66 () {58 vars in 1215 bytes} [Fri Jul 29 13:29:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87267584 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 13:30:01.848918 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:01.849506 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:01.855678 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:01.856132 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:01.856896 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:01.857333 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:01.870535 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] HTTP exception thrown: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Request method failure captured: Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 HTTP/1.1 Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49fk3Rs_iAESg1_sZjEEX-mNZC8cQ_6DqMGCvoG3aPTg7fnjR3c39A2RpB1A1uU39T7U1I8SoAisDCOTcSd09wGAeYMuoEDLyQU6Smeb4dnRaILkgIHt7Kqdisu6ZSeAjcKMUPkSUekTKOzptG06OfEL5UtXC1oJvoqWMcc49pNtaLY Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 13:30:01.872313 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 03f312d5c7334ccc82be17c5dfe29aeb Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.873637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '0648f4c1-242e-4fa9-ad53-9f4d24cfe259'} Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:30:01.874517 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.875800 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.878035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Returning 404 to user: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:30:01.878035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-3c51d9d5-ae5f-4fbb-8b9b-7cf50aa54eb0 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 404 len: 111 microversion: 2.1 time: 0.028778 Jul 29 13:30:01.878035 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1003/2032] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:30:01 2022] DELETE /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:30:01.883510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:01.884130 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 0648f4c1-242e-4fa9-ad53-9f4d24cfe259] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:01.894914 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:01.895568 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:01.896834 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:01.897461 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:01.911874 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] HTTP exception thrown: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Request method failure captured: Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 HTTP/1.1 Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49fk3Rs_iAESg1_sZjEEX-mNZC8cQ_6DqMGCvoG3aPTg7fnjR3c39A2RpB1A1uU39T7U1I8SoAisDCOTcSd09wGAeYMuoEDLyQU6Smeb4dnRaILkgIHt7Kqdisu6ZSeAjcKMUPkSUekTKOzptG06OfEL5UtXC1oJvoqWMcc49pNtaLY Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 13:30:01.913519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 03f312d5c7334ccc82be17c5dfe29aeb Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.914846 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '0648f4c1-242e-4fa9-ad53-9f4d24cfe259'} Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:30:01.918525 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. Jul 29 13:30:01.919793 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:01.920651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Returning 404 to user: Instance 0648f4c1-242e-4fa9-ad53-9f4d24cfe259 could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:30:01.920651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3ee60fc-e702-4990-a769-1c05ee5530fc tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259" status: 404 len: 111 microversion: 2.1 time: 0.036017 Jul 29 13:30:01.920651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1030/2033] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:01 2022] GET /compute/v2.1/servers/0648f4c1-242e-4fa9-ad53-9f4d24cfe259 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:30:03.059633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:03.060114 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:03.067770 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:03.068225 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:03.068994 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:03.069438 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:03.085540 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] HTTP exception thrown: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Request method failure captured: Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c HTTP/1.1 Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi49fk3Rs_iAESg1_sZjEEX-mNZC8cQ_6DqMGCvoG3aPTg7fnjR3c39A2RpB1A1uU39T7U1I8SoAisDCOTcSd09wGAeYMuoEDLyQU6Smeb4dnRaILkgIHt7Kqdisu6ZSeAjcKMUPkSUekTKOzptG06OfEL5UtXC1oJvoqWMcc49pNtaLY Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 13:30:03.087143 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 03f312d5c7334ccc82be17c5dfe29aeb Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.088452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '80d9675c-1827-4d5f-9ffc-2ec302ef475c'} Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:30:03.089201 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.090266 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.091244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Returning 404 to user: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:30:03.091244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-23694c91-5658-40bf-b145-493afda06f02 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 404 len: 111 microversion: 2.1 time: 0.032813 Jul 29 13:30:03.091244 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1004/2034] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:30:03 2022] DELETE /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:30:03.096946 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:03.097560 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] [instance: 80d9675c-1827-4d5f-9ffc-2ec302ef475c] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:03.104472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:03.105008 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:03.105947 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:03.106391 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:03.120687 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] HTTP exception thrown: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Request method failure captured: Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c HTTP/1.1 Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi49fk3Rs_iAESg1_sZjEEX-mNZC8cQ_6DqMGCvoG3aPTg7fnjR3c39A2RpB1A1uU39T7U1I8SoAisDCOTcSd09wGAeYMuoEDLyQU6Smeb4dnRaILkgIHt7Kqdisu6ZSeAjcKMUPkSUekTKOzptG06OfEL5UtXC1oJvoqWMcc49pNtaLY Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 13:30:03.122510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f36dffd2ab1643ed939ffe87e5928187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: f36dffd2ab1643ed939ffe87e5928187 Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1670024508 Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 03f312d5c7334ccc82be17c5dfe29aeb Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-AttachVolumeTestJSON-1670024508-project Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.123713 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '80d9675c-1827-4d5f-9ffc-2ec302ef475c'} Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:30:03.124345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. Jul 29 13:30:03.125393 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:30:03.126414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] Returning 404 to user: Instance 80d9675c-1827-4d5f-9ffc-2ec302ef475c could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:30:03.126414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-cb93bc4a-343c-4ab9-83fe-fb9aca8a03b1 tempest-AttachVolumeTestJSON-1670024508 tempest-AttachVolumeTestJSON-1670024508-project] 10.222.0.66 "GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c" status: 404 len: 111 microversion: 2.1 time: 0.030716 Jul 29 13:30:03.126414 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1031/2035] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:03 2022] GET /compute/v2.1/servers/80d9675c-1827-4d5f-9ffc-2ec302ef475c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:30:34.071086 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-278131582", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "networks": [{"uuid": "140808dd-1692-4ea5-b17a-e314a44318d3"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:30:34.079679 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=12 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:34.080376 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=20 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:34.128235 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] validate_networks() for [('140808dd-1692-4ea5-b17a-e314a44318d3', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 13:30:34.489096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 13:30:34.489522 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 13:30:34.490052 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 13:30:34.490956 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 13:30:34.491370 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 13:30:34.500373 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:34.500809 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:34.501602 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:34.502069 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:34.518811 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Getting quotas for project 9a86813dfa9c4d0d8c0217d29d1318f5. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 13:30:34.522695 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Getting quotas for user 96422547f7fb45a7a0920e520d66870c and project 9a86813dfa9c4d0d8c0217d29d1318f5. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 13:30:34.533315 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 13:30:34.535539 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 13:30:34.580500 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-746de7e4-e72f-42a9-8ea7-a3d0e69add50 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514004 Jul 29 13:30:34.581121 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1005/2036] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 13:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 13:30:34.591855 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-e0027f4c-68db-4da0-9608-b640c7fb2942 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:34.592462 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-e0027f4c-68db-4da0-9608-b640c7fb2942 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:34.594724 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:34.595363 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:34.650730 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-e0027f4c-68db-4da0-9608-b640c7fb2942 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:34.657352 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-e0027f4c-68db-4da0-9608-b640c7fb2942 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1218 microversion: 2.1 time: 0.069286 Jul 29 13:30:34.657944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1032/2037] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:34 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:35.679303 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:35.679916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:35.688459 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:35.689156 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:35.689974 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:35.690429 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:35.757812 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:35.765893 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-46e67cef-85ba-49f8-a5d1-ca5abde3c00f tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1276 microversion: 2.1 time: 0.091424 Jul 29 13:30:35.766824 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1006/2038] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:35 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:36.787242 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:36.787869 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:36.795319 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:36.795774 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:36.796547 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:36.796991 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:36.926937 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:36.935924 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-2080ea07-6892-4cb3-8f28-e4ea23be16f0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.152643 Jul 29 13:30:36.936491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1033/2039] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:36 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:37.255176 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-d35471e0-c6e4-417c-9c02-f6a21bd0dc4b req-8c9d7944-dd0d-4390-b5a6-07408093e88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87c828-a99a-4682-9a9d-73e3c951faaa", "tag": "53f880eb-508f-4a55-802e-cb4083cc1a6b"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:30:37.270301 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d35471e0-c6e4-417c-9c02-f6a21bd0dc4b req-8c9d7944-dd0d-4390-b5a6-07408093e88c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:37.270750 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-d35471e0-c6e4-417c-9c02-f6a21bd0dc4b req-8c9d7944-dd0d-4390-b5a6-07408093e88c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:37.282521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-d35471e0-c6e4-417c-9c02-f6a21bd0dc4b req-8c9d7944-dd0d-4390-b5a6-07408093e88c service nova] Creating event network-changed:53f880eb-508f-4a55-802e-cb4083cc1a6b for instance 5f87c828-a99a-4682-9a9d-73e3c951faaa on hv-cinder-81914 Jul 29 13:30:37.287776 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-d35471e0-c6e4-417c-9c02-f6a21bd0dc4b req-8c9d7944-dd0d-4390-b5a6-07408093e88c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035823 Jul 29 13:30:37.288367 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1007/2040] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:30:37.957037 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:37.957651 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:37.964747 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:37.965201 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:37.965990 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:37.966465 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:38.099423 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:38.106781 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0f7c2a0b-ea8b-4336-94bc-329ba30f6175 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.153624 Jul 29 13:30:38.107345 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1034/2041] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:37 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:39.128559 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:39.129355 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:39.136691 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:39.137160 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:39.137993 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:39.138441 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:39.279129 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:39.286599 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-482deb98-c824-4469-b437-746b2718564b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.162640 Jul 29 13:30:39.287541 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1008/2042] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:39 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:40.310133 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:40.310783 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:40.317224 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:40.317676 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:40.318979 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:40.319417 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:40.448511 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:40.456199 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-755a130a-a5dd-4126-b035-8391473ed0f1 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.149937 Jul 29 13:30:40.456933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1035/2043] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:40 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:41.478168 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:41.478805 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:41.485293 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:41.485739 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:41.486530 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:41.486975 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:41.644194 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:41.652257 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-f3945bf3-296d-4229-b8bf-74304f54927e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.178862 Jul 29 13:30:41.652810 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1009/2044] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:41 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:30:42.672210 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:42.672949 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:42.680435 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:42.680916 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:42.681696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:42.682600 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:42.866842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:42.875510 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-b1b212bc-491d-4926-ac12-1c2049f874ee tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.206890 Jul 29 13:30:42.876466 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1036/2045] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:42 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:43.896458 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:43.897077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:43.903940 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:43.904399 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:43.905332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:43.905841 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:44.040446 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:44.047973 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fb988f53-4a32-4a8a-8929-5035b18413f8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.155483 Jul 29 13:30:44.048617 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1010/2046] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:43 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:44.599155 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-4a82d4b7-9603-4be6-8e78-4c8a2c49196f req-f53534be-ce57-494f-93c7-449df06a1160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87c828-a99a-4682-9a9d-73e3c951faaa", "name": "network-vif-plugged", "status": "completed", "tag": "53f880eb-508f-4a55-802e-cb4083cc1a6b"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:30:44.614859 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-4a82d4b7-9603-4be6-8e78-4c8a2c49196f req-f53534be-ce57-494f-93c7-449df06a1160 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:44.615885 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-4a82d4b7-9603-4be6-8e78-4c8a2c49196f req-f53534be-ce57-494f-93c7-449df06a1160 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:44.628740 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-4a82d4b7-9603-4be6-8e78-4c8a2c49196f req-f53534be-ce57-494f-93c7-449df06a1160 service nova] Creating event network-vif-plugged:53f880eb-508f-4a55-802e-cb4083cc1a6b for instance 5f87c828-a99a-4682-9a9d-73e3c951faaa on hv-cinder-81914 Jul 29 13:30:44.634989 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-4a82d4b7-9603-4be6-8e78-4c8a2c49196f req-f53534be-ce57-494f-93c7-449df06a1160 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040220 Jul 29 13:30:44.635402 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1037/2047] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:30:45.068759 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:45.069394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:45.071788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:45.072514 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:45.079494 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:45.079992 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:45.080932 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:45.081396 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:45.219605 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:45.227865 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-65f34cbf-9b9f-49af-af8f-73b148a19a6e tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1318 microversion: 2.1 time: 0.163373 Jul 29 13:30:45.228532 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1011/2048] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:45 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:30:46.249519 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:30:46.250277 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:30:46.252244 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:30:46.258711 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:46.259166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:46.259940 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:30:46.260379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:30:46.397938 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:30:46.405449 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-d3d36fd7-d95d-4ff2-94c7-1a7fdc42c32d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1506 microversion: 2.1 time: 0.160328 Jul 29 13:30:46.406058 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1038/2049] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:30:46 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:01.652552 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06e14761-b3a9-4b13-97e0-749c17d7fd32", "device": "/dev/sdb"}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:31:01.655965 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:01.657952 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:01.658815 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=34 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:01.665196 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:01.665658 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:01.666461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:01.666906 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:01.919565 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-61d6341e-e2ac-45d4-bc36-71a9cd6972cb tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "POST /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270982 Jul 29 13:31:01.920557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1012/2050] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 13:31:01 2022] POST /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:31:26.675588 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:26.676082 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:26.678054 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=16 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:26.678799 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=32 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:26.685616 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:26.686168 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:26.686975 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:26.687413 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:26.767942 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lazy-loading 'services' on Instance uuid 5f87c828-a99a-4682-9a9d-73e3c951faaa {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 13:31:26.839656 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4b1e7b09-7aa5-45b0-ae48-12b0872b6a1d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa/os-volume_attachments/06e14761-b3a9-4b13-97e0-749c17d7fd32" status: 202 len: 0 microversion: 2.1 time: 0.167841 Jul 29 13:31:26.840288 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1039/2051] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 13:31:26 2022] DELETE /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa/os-volume_attachments/06e14761-b3a9-4b13-97e0-749c17d7fd32 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 13:31:27.957843 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:27.958630 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:27.963833 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:27.964704 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:27.972415 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:27.972869 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:27.973629 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:27.974103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:28.000585 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Going to try to terminate instance {{(pid=129323) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 13:31:28.073470 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-ae5eb34b-8a9d-4678-98ef-9e60f59a8db0 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 204 len: 0 microversion: 2.1 time: 0.116817 Jul 29 13:31:28.074087 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1013/2052] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:31:27 2022] DELETE /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 13:31:28.084323 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:28.085024 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:28.091412 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:28.091867 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:28.092642 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:28.093080 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:28.242091 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:28.249776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-5b3c9df1-bbd9-422a-af64-696cbfa1a9ef tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1512 microversion: 2.1 time: 0.171069 Jul 29 13:31:28.250379 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1040/2053] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:28 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:29.271452 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:29.272151 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:29.279186 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:29.279636 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:29.280410 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:29.280853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:29.408910 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:29.417074 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-b14151e8-3b14-4f5f-a866-353c1d9bf8d3 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1512 microversion: 2.1 time: 0.149864 Jul 29 13:31:29.417633 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1014/2054] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:29 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:30.077901 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-9f586a8d-7d85-40f0-b9b8-7488f5ade28b req-ed6b2574-61ba-41d9-af79-31650160546c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87c828-a99a-4682-9a9d-73e3c951faaa", "name": "network-vif-deleted", "tag": "53f880eb-508f-4a55-802e-cb4083cc1a6b"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:31:30.089163 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-9f586a8d-7d85-40f0-b9b8-7488f5ade28b req-ed6b2574-61ba-41d9-af79-31650160546c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:30.089664 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-9f586a8d-7d85-40f0-b9b8-7488f5ade28b req-ed6b2574-61ba-41d9-af79-31650160546c service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:30.102089 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-9f586a8d-7d85-40f0-b9b8-7488f5ade28b req-ed6b2574-61ba-41d9-af79-31650160546c service nova] Creating event network-vif-deleted:53f880eb-508f-4a55-802e-cb4083cc1a6b for instance 5f87c828-a99a-4682-9a9d-73e3c951faaa on hv-cinder-81914 Jul 29 13:31:30.107169 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-9f586a8d-7d85-40f0-b9b8-7488f5ade28b req-ed6b2574-61ba-41d9-af79-31650160546c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033076 Jul 29 13:31:30.107761 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1041/2055] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:31:30.440103 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:30.440828 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:30.447853 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:30.448314 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:30.449085 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:30.449529 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:30.486046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:30.486507 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:30.487306 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lazy-loading 'fault' on Instance uuid 5f87c828-a99a-4682-9a9d-73e3c951faaa {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 13:31:30.530490 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:30.538795 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-321a3579-c8b5-4975-b485-db746ff46079 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 200 len: 1308 microversion: 2.1 time: 0.102907 Jul 29 13:31:30.539491 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1015/2056] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:30 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:31.561589 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:31.562302 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 5f87c828-a99a-4682-9a9d-73e3c951faaa] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:31.568514 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:31.568961 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:31.569710 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:31.570176 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:31.583056 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.wsgi [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] HTTP exception thrown: Instance 5f87c828-a99a-4682-9a9d-73e3c951faaa could not be found. Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Request method failure captured: Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: request: GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa HTTP/1.1 Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept: application/json Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Accept-Encoding: identity Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Connection: close Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Length: 0 Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Content-Type: application/json Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Host: 10.222.0.66 Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Openstack-System-Scope: None Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: User-Agent: python-urllib3/1.26.10 Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Auth-Token: gAAAAABi4-D4-XcSb_a2gKY1YnKMpYHf2WutuULdkyMCqA-f4gAfumacBmD6wSXseXMhLSyC0WgCiFNgGQTDhDlJVr4TU3wa5zeH3X38X83RXf3KFxVmrIK5-2iQrOMHsYD5GzvChUTPpZ2brkQnscDVvnCHd1ejQp83dXpFduXmmHt34siioMY Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Id: None Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Domain-Name: None Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Identity-Status: Confirmed Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Is-Admin-Project: True Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Id: default Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Domain-Name: Default Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Id: 9a86813dfa9c4d0d8c0217d29d1318f5 Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1794383485 Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Role: reader,member Jul 29 13:31:31.584633 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Roles: reader,member Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant: tempest-VolumesSnapshotTestJSON-1794383485 Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Id: 9a86813dfa9c4d0d8c0217d29d1318f5 Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1794383485 Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User: tempest-VolumesSnapshotTestJSON-1794383485-project Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Id: default Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Domain-Name: Default Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Id: 96422547f7fb45a7a0920e520d66870c Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: X-User-Name: tempest-VolumesSnapshotTestJSON-1794383485-project Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: method: > Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: exception: Instance 5f87c828-a99a-4682-9a9d-73e3c951faaa could not be found. Jul 29 13:31:31.586492 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: action_args: {'id': '5f87c828-a99a-4682-9a9d-73e3c951faaa'} Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f87c828-a99a-4682-9a9d-73e3c951faaa could not be found. Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:31:31.587220 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f87c828-a99a-4682-9a9d-73e3c951faaa could not be found. Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f87c828-a99a-4682-9a9d-73e3c951faaa could not be found. Jul 29 13:31:31.588394 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: ERROR nova.api.openstack.wsgi Jul 29 13:31:31.589575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Returning 404 to user: Instance 5f87c828-a99a-4682-9a9d-73e3c951faaa could not be found. {{(pid=129324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:31:31.589575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0a1d3fe6-66c2-4510-9548-d28678a77c35 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa" status: 404 len: 111 microversion: 2.1 time: 0.029969 Jul 29 13:31:31.589575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1042/2057] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:31 2022] GET /compute/v2.1/servers/5f87c828-a99a-4682-9a9d-73e3c951faaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:31:40.436394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-850592858", "imageRef": "e8ba10a1-f4e7-4eb4-825a-e77845378518", "flavorRef": "452", "networks": [{"uuid": "140808dd-1692-4ea5-b17a-e314a44318d3"}]}} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:31:40.488387 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.network.neutron [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] validate_networks() for [('140808dd-1692-4ea5-b17a-e314a44318d3', None, None, None, None, None)] {{(pid=129323) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 13:31:40.535346 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:40.833609 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Flavor limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 13:31:40.834067 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Image limits 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 13:31:40.835180 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Flavor pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 13:31:40.835604 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Image pref 0:0:0 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 13:31:40.836021 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.virt.hardware [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129323) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 13:31:40.845871 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:40.846363 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:40.847174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:40.847618 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:40.864246 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Getting quotas for project 9a86813dfa9c4d0d8c0217d29d1318f5. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 13:31:40.868264 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.quota [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Getting quotas for user 96422547f7fb45a7a0920e520d66870c and project 9a86813dfa9c4d0d8c0217d29d1318f5. Resources: {'cores', 'instances', 'ram'} {{(pid=129323) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 13:31:40.879590 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Going to run 1 instances... {{(pid=129323) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 13:31:40.882368 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ba10a1-f4e7-4eb4-825a-e77845378518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129323) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 13:31:40.929061 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-1c3d2375-b0ac-499d-a2ab-d1ccda7fd7be tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496373 Jul 29 13:31:40.929640 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1016/2058] 10.222.0.66 () {60 vars in 1147 bytes} [Fri Jul 29 13:31:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 13:31:40.941755 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-93d72e8f-7cdb-43cc-8834-b6491726534d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:40.942396 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-93d72e8f-7cdb-43cc-8834-b6491726534d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:40.997015 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-93d72e8f-7cdb-43cc-8834-b6491726534d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:41.003776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-93d72e8f-7cdb-43cc-8834-b6491726534d tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1218 microversion: 2.1 time: 0.065804 Jul 29 13:31:41.004333 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1043/2059] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:40 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 13:31:42.025666 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:42.026435 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:42.033147 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:42.033703 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:42.034574 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:42.035080 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:42.228889 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:42.236394 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-d9b49fc6-b096-4eaa-872b-7c3b78037968 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1276 microversion: 2.1 time: 0.215736 Jul 29 13:31:42.236963 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1017/2060] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:42 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:43.257217 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:43.257849 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:43.259789 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:43.267922 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:43.268523 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:43.269315 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:43.269750 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:43.387702 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-443e5e33-c814-4a54-962b-5843c74ab913 req-d165729b-aea8-4ab7-ad92-3c135bb40725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "732a2d76-0a57-4d6c-91ff-40f5f08f6e3a", "tag": "d9fb19ac-8270-4c4a-8d83-a569a5a6ab1d"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:31:43.406573 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-443e5e33-c814-4a54-962b-5843c74ab913 req-d165729b-aea8-4ab7-ad92-3c135bb40725 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:43.407104 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-443e5e33-c814-4a54-962b-5843c74ab913 req-d165729b-aea8-4ab7-ad92-3c135bb40725 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:43.415061 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:43.420348 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-443e5e33-c814-4a54-962b-5843c74ab913 req-d165729b-aea8-4ab7-ad92-3c135bb40725 service nova] Creating event network-changed:d9fb19ac-8270-4c4a-8d83-a569a5a6ab1d for instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a on hv-cinder-81914 Jul 29 13:31:43.423499 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-8710f483-79ad-4f09-be21-ccd7859c3f77 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.170161 Jul 29 13:31:43.424405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1044/2061] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:43 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:43.425498 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-443e5e33-c814-4a54-962b-5843c74ab913 req-d165729b-aea8-4ab7-ad92-3c135bb40725 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041484 Jul 29 13:31:43.426371 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1018/2062] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:31:44.445324 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:44.445970 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:44.452571 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:44.453026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:44.453791 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:44.454273 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:44.583280 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:44.590840 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-0b089a59-539d-406a-8dc4-cb0637d59a37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.150053 Jul 29 13:31:44.596026 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1045/2063] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:44 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:45.612354 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:45.613054 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:45.619847 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:45.620305 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:45.621077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:45.621521 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:45.753332 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:45.761291 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-fd32d6e5-4d6e-4ee1-a2b0-7a5a4317b474 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.153652 Jul 29 13:31:45.761872 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1019/2064] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:45 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:46.782188 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:46.782802 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:46.790754 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:46.791215 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:46.791994 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:46.792433 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:46.923637 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:46.934365 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4621f4d6-a0d6-4f35-b737-06ce60da9c37 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.155639 Jul 29 13:31:46.935314 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1046/2065] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:46 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:47.956684 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:47.957265 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:47.964916 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:47.965358 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:47.966149 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:47.966675 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:48.103023 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:48.110391 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-16be04d4-74ae-4f9c-89bc-a95811ce1943 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.157624 Jul 29 13:31:48.110947 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1020/2066] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:47 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:48.691076 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:31:48.691297 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:31:48.977262 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [req-db1f59f2-762c-48ce-bc03-522ee159c772 req-f87d92a7-a24a-459b-ae23-9e84d6ceac19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732a2d76-0a57-4d6c-91ff-40f5f08f6e3a", "name": "network-vif-plugged", "status": "completed", "tag": "d9fb19ac-8270-4c4a-8d83-a569a5a6ab1d"}]} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:31:48.993107 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-db1f59f2-762c-48ce-bc03-522ee159c772 req-f87d92a7-a24a-459b-ae23-9e84d6ceac19 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:48.993769 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [req-db1f59f2-762c-48ce-bc03-522ee159c772 req-f87d92a7-a24a-459b-ae23-9e84d6ceac19 service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:49.012842 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.compute.server_external_events [req-db1f59f2-762c-48ce-bc03-522ee159c772 req-f87d92a7-a24a-459b-ae23-9e84d6ceac19 service nova] Creating event network-vif-plugged:d9fb19ac-8270-4c4a-8d83-a569a5a6ab1d for instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a on hv-cinder-81914 Jul 29 13:31:49.018612 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [req-db1f59f2-762c-48ce-bc03-522ee159c772 req-f87d92a7-a24a-459b-ae23-9e84d6ceac19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046479 Jul 29 13:31:49.019776 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1047/2067] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:31:49.131557 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:49.132145 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:49.138692 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:49.139148 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:49.139909 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:49.140349 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:49.267982 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:49.275334 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-365b50ba-4a8e-41e9-b9d8-88d935da4ad8 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.147671 Jul 29 13:31:49.275883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1021/2068] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:49 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:50.296259 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:50.296951 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:50.303873 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:50.304847 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:50.305584 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:50.306055 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:50.437731 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:50.445801 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-58705a73-263f-498e-8c47-9cf04e76cb24 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1318 microversion: 2.1 time: 0.153153 Jul 29 13:31:50.446388 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1048/2069] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:50 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:51.468471 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:31:51.469084 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:51.471436 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=2 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:51.472174 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell0:SELECT=6 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:51.478304 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:51.478788 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:51.479516 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:51.479958 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:51.621113 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:31:51.628900 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-8373efcc-7422-4a5f-9f3a-3ce3e49bf1cf tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1506 microversion: 2.1 time: 0.165386 Jul 29 13:31:51.629461 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1022/2070] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:31:51 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:31:51.654239 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50173dcc-6eca-4e79-8735-56c6ec743ca3", "device": "/dev/sdb"}} {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:31:51.657341 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:31:51.659544 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell0:SELECT=2 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:31:51.666337 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:51.667115 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:51.668035 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:31:51.668474 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:31:51.911696 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-4c913dac-9741-4512-8fc9-74f3bfe9528b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "POST /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261254 Jul 29 13:31:51.912339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1049/2071] 10.222.0.66 () {60 vars in 1323 bytes} [Fri Jul 29 13:31:51 2022] POST /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:32:08.202308 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:32:08.202909 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:32:09.147575 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:32:09.148087 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:32:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:32:10.204659 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:32:10.205154 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:32:10.207077 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:32:10.207809 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG dbcounter [-] [129323] Writing DB stats nova_cell1:SELECT=34 {{(pid=129323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:32:10.214418 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:10.214867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:10.215632 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:10.216065 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:10.297537 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.objects.instance [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lazy-loading 'services' on Instance uuid 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a {{(pid=129323) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 13:32:10.372685 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-614bb6d8-efb7-4aa5-9591-ae13178d1d76 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "DELETE /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a/os-volume_attachments/50173dcc-6eca-4e79-8735-56c6ec743ca3" status: 202 len: 0 microversion: 2.1 time: 0.171440 Jul 29 13:32:10.373212 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1023/2072] 10.222.0.66 () {58 vars in 1416 bytes} [Fri Jul 29 13:32:10 2022] DELETE /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a/os-volume_attachments/50173dcc-6eca-4e79-8735-56c6ec743ca3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 13:32:11.485491 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_api:SELECT=24 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:32:11.486339 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG dbcounter [-] [129324] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 13:32:11.490719 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:32:11.491310 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:32:11.499182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:11.499669 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:11.500436 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:11.500877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:11.527234 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Going to try to terminate instance {{(pid=129324) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 13:32:11.600485 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7446b882-8b93-4542-843e-a8a7e105ce4a tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "DELETE /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 204 len: 0 microversion: 2.1 time: 0.116148 Jul 29 13:32:11.601076 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1050/2073] 10.222.0.66 () {58 vars in 1239 bytes} [Fri Jul 29 13:32:11 2022] DELETE /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 13:32:11.610935 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:32:11.611662 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:32:11.618637 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:11.619096 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:11.619867 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:11.620311 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:11.764583 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.policy [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129323) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:32:11.772130 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-7b1d4249-1ae7-4f47-b4b3-4d111ecaf599 tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1512 microversion: 2.1 time: 0.166186 Jul 29 13:32:11.772694 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1024/2074] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:32:11 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:32:12.794559 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:32:12.795256 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:32:12.801679 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:12.802166 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:12.802933 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:12.803371 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:12.929643 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:32:12.937620 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-7e5df850-512b-4603-893a-88f7d141563b tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1512 microversion: 2.1 time: 0.147408 Jul 29 13:32:12.938208 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1051/2075] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:32:12 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:32:13.688698 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [req-4a7b5dba-fb35-4e1a-8d07-906e0c4c0073 req-f754fd6f-4b02-4849-9051-29589c437f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732a2d76-0a57-4d6c-91ff-40f5f08f6e3a", "name": "network-vif-deleted", "tag": "d9fb19ac-8270-4c4a-8d83-a569a5a6ab1d"}]} {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 13:32:13.700218 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-4a7b5dba-fb35-4e1a-8d07-906e0c4c0073 req-f754fd6f-4b02-4849-9051-29589c437f5f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:13.700577 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [req-4a7b5dba-fb35-4e1a-8d07-906e0c4c0073 req-f754fd6f-4b02-4849-9051-29589c437f5f service nova] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:13.712118 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.compute.server_external_events [req-4a7b5dba-fb35-4e1a-8d07-906e0c4c0073 req-f754fd6f-4b02-4849-9051-29589c437f5f service nova] Creating event network-vif-deleted:d9fb19ac-8270-4c4a-8d83-a569a5a6ab1d for instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a on hv-cinder-81914 Jul 29 13:32:13.717169 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [req-4a7b5dba-fb35-4e1a-8d07-906e0c4c0073 req-f754fd6f-4b02-4849-9051-29589c437f5f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032294 Jul 29 13:32:13.717763 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1025/2076] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 29 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 13:32:13.959307 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.api.openstack.wsgi [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:32:13.959862 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.compute.api [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129324) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:32:13.966401 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:13.966856 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:13.967613 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:13.968047 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:14.001944 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:14.003030 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG oslo_concurrency.lockutils [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:14.003539 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.objects.instance [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lazy-loading 'fault' on Instance uuid 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a {{(pid=129324) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 13:32:14.048877 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: DEBUG nova.policy [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96422547f7fb45a7a0920e520d66870c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a86813dfa9c4d0d8c0217d29d1318f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129324) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 13:32:14.060405 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO nova.api.openstack.requestlog [None req-19e89092-6318-4bc1-a3ff-f4a27d4eb6ad tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 200 len: 1308 microversion: 2.1 time: 0.104945 Jul 29 13:32:14.061634 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: [pid: 129324|app: 0|req: 1052/2077] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:32:13 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 13:32:15.085644 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Calling method '>' {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 13:32:15.087006 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.compute.api [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] [instance: 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a] Fetching instance by UUID {{(pid=129323) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 13:32:15.095423 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:15.095883 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:15.096669 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 13:32:15.097146 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG oslo_concurrency.lockutils [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Lock "700a5828-9678-4497-a9ca-54189636954d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 13:32:15.113324 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.wsgi [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] HTTP exception thrown: Instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a could not be found. Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Request method failure captured: Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: request: GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a HTTP/1.1 Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept: application/json Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Accept-Encoding: identity Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Connection: close Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Length: 0 Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Content-Type: application/json Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Host: 10.222.0.66 Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Openstack-System-Scope: None Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: User-Agent: python-urllib3/1.26.10 Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Auth-Token: gAAAAABi4-D4-XcSb_a2gKY1YnKMpYHf2WutuULdkyMCqA-f4gAfumacBmD6wSXseXMhLSyC0WgCiFNgGQTDhDlJVr4TU3wa5zeH3X38X83RXf3KFxVmrIK5-2iQrOMHsYD5GzvChUTPpZ2brkQnscDVvnCHd1ejQp83dXpFduXmmHt34siioMY Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Id: None Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Domain-Name: None Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Identity-Status: Confirmed Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Is-Admin-Project: True Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Id: default Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Domain-Name: Default Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Id: 9a86813dfa9c4d0d8c0217d29d1318f5 Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1794383485 Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Role: reader,member Jul 29 13:32:15.115007 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Roles: reader,member Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a86813dfa9c4d0d8c0217d29d1318f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant: tempest-VolumesSnapshotTestJSON-1794383485 Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Id: 9a86813dfa9c4d0d8c0217d29d1318f5 Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1794383485 Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User: tempest-VolumesSnapshotTestJSON-1794383485-project Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Id: default Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Domain-Name: Default Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Id: 96422547f7fb45a7a0920e520d66870c Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: X-User-Name: tempest-VolumesSnapshotTestJSON-1794383485-project Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: method: > Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: exception: Instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a could not be found. Jul 29 13:32:15.116230 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: action_args: {'id': '732a2d76-0a57-4d6c-91ff-40f5f08f6e3a'} Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: {{(pid=129323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a could not be found. Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 13:32:15.116917 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a could not be found. Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a could not be found. Jul 29 13:32:15.118046 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: ERROR nova.api.openstack.wsgi Jul 29 13:32:15.119012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: DEBUG nova.api.openstack.wsgi [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] Returning 404 to user: Instance 732a2d76-0a57-4d6c-91ff-40f5f08f6e3a could not be found. {{(pid=129323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 13:32:15.119012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO nova.api.openstack.requestlog [None req-cff59b71-4f90-44b9-b4be-f85b948c43fe tempest-VolumesSnapshotTestJSON-1794383485 tempest-VolumesSnapshotTestJSON-1794383485-project] 10.222.0.66 "GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a" status: 404 len: 111 microversion: 2.1 time: 0.036916 Jul 29 13:32:15.119012 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: [pid: 129323|app: 0|req: 1026/2078] 10.222.0.66 () {58 vars in 1236 bytes} [Fri Jul 29 13:32:15 2022] GET /compute/v2.1/servers/732a2d76-0a57-4d6c-91ff-40f5f08f6e3a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 13:33:51.556642 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:33:51.557189 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:35:08.700591 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:35:08.701274 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:35:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:35:28.210903 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:35:28.211472 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:35:29.156034 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:35:29.156182 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:37:11.564665 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:37:11.565222 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:37:23.662666 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:37:23.663126 dv-cinder-819149-16-iscsi devstack@n-api.service[129324]: Fri Jul 29 13:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 13:37:33.340861 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 13:37:33.341424 dv-cinder-819149-16-iscsi devstack@n-api.service[129323]: Fri Jul 29 13:37:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!